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ABSTRACT 

This docuient is part of a series dealing with 
nonfornal education. Introductory inforiation is included in doeunent 
SO 008 058. The focus of this report is on the learningf effectiveness 
of nonforaal education. Chapter 1 compares effective learning in a 
fornal and nonforaal environment. Chapter 2 develops a systess sodel 
for designers of learning experiences within nonforaal education. The 
third chapter specifically looks at one part of the systess nodel 
through exaaination of a prototype in Srazil. Chapter U enphasizes 
the relationship of evaluation to increased learning effectiveness. 
The fifth chapter illustrates the use of evaluation and the design of 
the iedia-fix for effective instructional delivery in a case s|l|dy 
froB Mexico, Chapter 6 reviews and relates research on the dllfiliion 
of innovation to the problem of learning effectiveness in nonferaai 
education. The seventh chapter is a case study of the transforaation 
and developaent of education in china since the revolution. Of 
special interest in this section is the reduction in the distinction 
between foraal and nonforaal education in China. The authors exaaine 
this trend and its relationship to the reward systea of education and 
the reward systeas of the society as a whole. (DE) 
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FOREWORD 



The Michigan State University Program of Studies In Non'-formal 
Education, made possible by the Agency for International Development, 
has two primary objectives: to build a systematic knowledge base 
about non-formal education, and to apply knowledge through consultation 
technical assistance, workshops, and the distribution of useful ma" 
terlals in developing areas of the world. 

This series of Team Reports Is directed at the first objective, 
knowledge building. The series consists of the final statements of 
nine teams of faculty members and research fellows, each working on a 
separate aspect of non-formal education for a substalned period of 
time. The reports range widely over non-formal education. They deal 
with its history, its categories and strategies, economics, and 
learning. Other reports made comparisons among country programs, 
survey case studies, examine the feasibility of designing non-formal 
education models, look at administrative alternatives and draw plans 
for participant training In non-formal education. 

The teams were cross-d Isc Ipl Inary In composition, representing 
such areas as economics, labor and Industrial relations, political 
science, public administration, agricultural economics, sociology and 
education. Together, members of the teams produced nearly one hundred 
working papers, many of which were shared and debated In three series 
of semt-weekly seminars for all project participants. The working 
papers, copies of which are available upon request, provide the basic 
Ideas for the reports In this series. 

In the Interest of the freest possible exploration, each team 
was encouraged to range widely over Its domain and to develop Its own 
set of conclusions and recommendations. Coordination was achieved 
through the common seminars and the exchange of data and experience. 
A summary volume, pulling together and synthesizing the main thrusts 
of all the team reports In this series, Is being prepared under the 
editorship of Marvin Grandstaff . Like the working papers, the summary 
volume will be available for distribution, 

I 



In line with our first objective (knowledge bulld(ng) the papers 
In this series are conceptual In nature. In the pursuit of knowledge, 
however, we have tried to keep one question steadily before us{ what 
assistance does this knowledge provide to those whose primary concern 
Is with action— the planning and Implementing of non-formal education 
at the level of practice? That question Isn't easily answered, At 
best our knowledge Is partial and It needs the experience dimension 
to make It more complete. For thought and action are not antithetical; 
they are necessary complements. One of our hopes Is that this series 
^ of team reports may help to stimulate further dialogue between those 
who approach the subject of non-formal education from a conceptual 
point of view and those whose questions and problems arise In the 
exigencies of practice. 

What is the role of non-formal education In future development 
planning? As these reports suggest. It Is probably great, and will be 
even greater through future time. The limitations of formal schooling 
are coming to be better understood. As the Faure report concludes, 
the schools "will be less and less In a position to claim the education 
functions in society as its special perogatlve. All sectors—public 
administration, industry, communcatlons, transportat lon--must take part 
in promoting education. Local and national communities are In them- 
selves eminently education institutions". 

The non-formal education component of most societies Is strong, 
indeed frequently vigorous, and fully capable of further development 
and use. It Is estimated that roughly half of the present educational 
effort in the developing countries is In the non-formal sector. Col- 
lectively, these programs exhibit characteristics indlspenslble to 
development. For example, they tend to arise In response to Immediate 
needs; they are usually related to action and use; they tend to be 
short term rather than long; they have a variety of sponsors, both 
public and private; and they tend to be responsive to local community 
requirements. More importantly non-formal education shows strong 



ii 



00007 



BEST COPY AVAIUBLE 

potential for getting at the human condition of those most likely 
to be excluded from the formal school s.«the poor* the Isolated, the 
rural, the Illiterate, the unemployed and the under-employed-- for 
being carried on In the context of limited resources, and for being 
efficient In terms of time and cost. 

Clearly, attention given to designing new strategies for the 
development of this old and promising resource Is worthwhile. Through 
this series we seek to join hands with others who are attending to the 
development of non-formal education. 



Cole S, Brembeck, Director 

Institute for International Studies 

College of Education 

Michigan State University 

East Lansing, Michigan 
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INTRODUCTORY REVIEW 



Ted W. Ward 

From their many viewpoints, educational planners, evaluators, 
curriculum specialists, communication scientists and other researchers 
are examining non-formal educat ion . Non-formal education se^ms to be 
an emerging phenomenon around the world; It Is more correctly described 
as an emerging awareness . For some, "non- formal education" refers to a 
search for ways to extend the influence of education through lower*cost 
modes of delivery. For others. It Is a concern for fundamentally 
different goals and approaches to effective learning. 

The particular interest of the authors is "learning effective* 
ness" within non-formal education. Learning effectiveness Is an 
arbitrary term intended to indicate the problems associated with the 
strengths and weaknesses of a program at the learner's level— the 
instructional effects or the learning experiences within a non-formal 
learning environment. Questions dealing with the impact or worth of 
learning experiences are raised: Is there any difference In the 
characteristics of a good learning experience in a non-formal environ*^ 
ment and in a formal environment? Is there anything about the non* 
format environment that makes for assets or liabilities in learning? 
I? there anything that should be or can be done differently In a non- 
formal learning environment? 

The study of learning effect i \/eness In non-formal education 
does not lend itself to the ordinary ways and means of review* First, 
the literature In the field of learning research rarely refers to 
'Mearning effectiveness," as ^uch. Further, since there are no strong 
traditions of research thv^t differentiate learning In formal and non- 
formal environments, It Is necessary to relate Ideas Inferential ly from 
various forms of scholarly literature and to collate diverse 

1 
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knowledge and varied experiences, attempting to build a synthesis out of 
what can be said about learning In different environments. 

Because research In human learning has been conducted largely 
by scientists within the Inst i tut ions of formal education, the concepts, 
findings, and interpretations of learning research are extensively 
bound up in assumptions characteristic of formal education. Most 
studies that contribute to learning theory are designed by scholars 
who, themselves, are indebted to formal education; their studies 
typically are conducted by advanced collegians and graduate students; 
and college sophomores and juniors are ordinarily recruited as experi- 
mental subjects. These practices of the learning researchers may be 
justified, but they demand continuous caution In the generalization of 
findings to all populations. Further, the standard concepts of learning 
that underlie the experimental research assume Instructional models much 
more like formal education than non-formal education. For example, 
research on the learning of nonsense syllables and other arbitrary 
learning tasks is representative of learning situations In which the 
learner has little or no interest and for which he must be motivated 
extr ins ical ly . 

Considering these problems within the traditions of research 
in human learning, we must at least hold open the possibility that 
what is known about human learning is more specific to the sort of 
learning that characterizes formal education, and that there may be, 
in fact, some differences in the aspects of learning that are involved 
in non-formal education. 

Though we begin with the rather fuzzy term "learning effective- 
ness," the work becomes somewhat more precise if we take "learning 
effectiveness" to mean consequential instructional communication . 
This focus allows us to work In a communication framework In addition 
to the. more classical teaching/learning framework. Thus we think In 
terms of diffusion, dissemination, behavior change, and adoption of 
innovation as evidences of learning effectiveness. This focus, as a 
matter of fact, fits rathe' well within the framework of the new 
emphases in psychology of learning which speak of learning as changed 
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behavior. Changed behavior Is inherently Innovative for the situation 
or the person; thus the pragmatic criterion of effectiveness Is 
adopt ion . Working bacl< from this end, we seek out some of the 
factors that are controllable variables within a learning environment, 
these are identified so that they can be made servants of the goals of 
educational effort. 

We have attempted to develop both a theoretical and a practical 
view of non'-formal education. We assume that what Is needed is a 
practical, pragmatic view. On the basis of our findings on the state 
of the art and the state of the 1 i terature--what we l<now about non- 
formal educat ion--there are certain things that can be recommended and 
certain things that should be discouraged. There are some assets and 
some liabilities in the non«formal educational experience and we point 
out what they mean and what they suggest to us« We Identify primarily 
with the more practical side of the Issues, but hopefully our theoretic 
ca) viork makes it possible for the reader to see the basis of the 
recommendations and use relevant data to derive his own conclusions 
about the validity of those recommendations. 

People with many different interests and various values are 
asking questions about non<*formal education. For some, non-formal 
education is primarily a way to extend the influence of the baste 
schooling systems. For persons holding this position, there Is much 
interest in extension and field-based training, in-servtce and con- 
tinuing education, as well as uses of mass-media for extending the 
influence and value of the structures of formal education* These 
concerns center on matters of alternative or expanded delivery 
systems for the sorts of education that schools have already been 
providing. Thus the interest in non-formal education is seen to be 
promising because it may represent a new emphasis on the value of 
education for wider sets of people. 

For others, interest in non-formal education is something 
else: a demand for al ternat i ves to formal schooling in order to do 
something worthwhile for those whose educational needs are not now 
being met. This position represents much more than the awareness of 
the importance of education; it arises from a conviction that new ways 
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are demanded so as to meet the needs of those who are now unable to 
bend themselves into the schooling estabi ishment--includlng the 
crucial problem of out-of -school youth. From this position, non- 
formal education is far more than new delivery systems; It Is the 
restructuring of goals and even the underlying assumptions about what 
constitutes worthwhile content in education. 

We are especially anxious about the premature building of 
large-scale policies and large-scale investments and programs of non- 
formal education. Large categorical loans, for example, could be 
potentially destructive of certain valuable forces within non-formal 
education. Benign neglect is bad enough, but the establishment of 
formal policies concerning the sorts of non-formal education that 
do and don't fit '^national policy** will surely have the effect of 
discouraging or even purging some of the vital programs that now exist. 
As large-scale funding of non-formal, educat ion is undertaken It should 
be accompanied by caution and safeguards. Non-formal education should 
not be ^'standardized** nor should it be insulated from the voice of its 
clients. What is needed is communication, not control. 

Structure of the Monograph 
The effectiveness problem is seen as a set of questions that 
can be looked at from several vantage points; thus the chapters 
represent an attempt to place ourselves at different vantage points 
to look into non-formal education. In order that our work not con- 
verge into a homogeneous mass, we have attempted to build separate 
chapters from these several vantage points. For example, the first 
chapter is concerned with the defining of learning effectiveness In 
special reference to non-formal learning environments and what they 
suggest about phenomena and characteristics of effective learning. 
We explore the question: "Compared with the formal learning environ- 
ment, is effective learning different in a non-formal environment?** 
And the ans//er we find is *V^s and no,** YeSt there are certain 
attributes relating to effectiveness that are more common to one 
mode than to the other. For example, typically in a non-formal 



00012 



5 



environment-- intermediate rewards are not utilized or are much less 
important than they are In formal education. Symbolic rewards, 
certificates, degrees and so forth (the pay-offs that you can't eat 
but that you are taught to hold in high regard In formal education), 
are virtually Inconsequential in the most exciting programs of non- 
formal education Non-formal education tends to be oriented to a 
reward system that is closer to the world of work and to the Improve- 
ment of the quality of everyday life. Thus it may be easier to 
J«nduc£ mot ivat ion in the formal environment, but easiej to capitalize 
on existing motivation in the non-formal environment. 

The second chapter represents the development of a systems 
model for designers of learning experiences within non-formal educa- 
tion. It is not a systems model for national planning or for resource 
allocations. Instead it assumes that if an organization Is Intent on 
using non-formal education, and that if someone has been given respon- 
sibility for designing instruction or approaches to the learning 
problem, a systems model such as this can alert him to the variables 
that an instructional plan can accommodate. As a planner and 
designer of instruction takes account of the interrelationships among 
these variables, he can assess which factors are most important In his 
own situation in order to make a good plan--a good design for 
effective learning. Those who have discovered the usefulness of 
"systems thinking" commonly believe that a preliminary model Is better 
than no model at all. To such people this paper will be encouraging. 

The third chapter takes a specific look at one part of the 
systems model through examination of an experimental example. Learner 
characteristics are seen as important variables in effective learning. 
The study of ethnological factors that characterize learners can lead 
to certain systematic transformations or adaptations of instructional 
materials and instructional approaches from one culture (or one 
setting within a culture) to another. Using an experimental procedure, 
we studied the question of transforming an instructional material to 
increase learning effectiveness. What do you need to know about people 
in order to know what needs to be changed in the instructional 
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approach? Programmed Instruction In four more-or-less culturally 
attuned variations was used In teaching a non-formal nutrition unit 
to some of the recently urbanized fringe populations in Sao Paulo, 
Brazil. Variants of the Instructional approach were developed on two 
continua: group/Individual mode, and discovery/expository style. The 
results of this experiment show the promising benefits of group 
experiences In discovery-learning, at least for learning effectiveness 
among this sort of population. 

The fourth chapter emphasizes the relationship of evaluation 
(especially formative evaluation) to the Increasing of learning effec- 
tiveness. The chapter consists of two parts: first, a compilation of 
the particular concepts and procedures in contemporary educational 
evaluation that seem most to relate to problems in non-formal educa- 
tion. This review Is followed by an illustrative case study describing 
the development and use of a comprehensive plan for formative evalua- 
tion within a large, non-formal education program the FASE of Brazil. 
The paoer is a sort of how-to-do- It manual, illustrated by an applica- 
tion of the principles and procedures. 

A case study from Mexico is the basis of the fifth chapter. 
Again viewing the non-formal education situation as an exercise in 
effective instru.ct ional conimunicat Ion, this chapter Illustrates both 
the use of evaluation and the design of the media-mix for el'fective 
instructional delivery. 

Sixth, a chapter has been written to review and relate 
research on the diffusion of innovations to the problem of learning 
effectiveness in non-formal education. The literature reviewed has 
been useful, as a whole, In re-thinl<ing the procedures whereby 
changes in methodology and forms of instructional materials might best 
be brought about in formal education. It is partly in reference to 
the problem of alteration and Improvement of educational services 
through new uses of non-formal education that this literature has 
value for the series. But even further, the fact that non-formal 
education is typically concerned with Innovation and change within a 
society--or at least within the life-experience of distinct target 
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audiences-^suggests that the whole of noiTformal education might best 
be seen as a set of non^school ing processes through which Innovations 
are being diffused. In this sense, the monograph views learning 
effectiveness as a matter of adoption of innovat Ions* Thus key con- 
cepts from the literature of communication theory can be brought to 
bear. 

The seventh chapter is a case study of the transformation and 
development of education in China since the revolution. In Just over 
a quarter-century the world^s largest nation has mobilized human 
resources in a way and in such a scale as to constitute significant 
precedents. One of the intriguing characteristics of education in 
China tod-jy is the reduction of the distinction between formal and non- 
formal education. The authors examine this trend and give special 
attention to the relationship between the reward system of education 
and the reward systems of the society as a whole. 

The final chapter is an illustrative collection of brief case 
studies written by people who have dedicated themselves to careers in 
non-formal education. Each of the authors represented In this 
chapter has distinguished himself as a knowledgeable **outstder** 
(North American or European) working to make his own role unnecessary 
by emphasising the development of human resources and leadership from 
among the indigenous populations for control and maintenance of non- 
formal education programs. / 

This monograph does not claim to represent the whole of non- 
formal education, The vast scope and complexity of non-formal education 
makes such a claim unreasonable for even the most burdensome tome. But 
we do claim, collectively, an amalgam of awareness, experience and 
insight that can serve the seeker as a responsible basis from which to 
gain a better perspective on the problems of effective learning and 
thus to become more able to design and operate effective programs of 
non-forma I educat ion . 

A ''Manual of Advisement in Non-Formal Education*' has been 
suggested and requested by certain country missions of USAIOi Actually 
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that "Manual of Advisement" is already in some of our minds and will 
probably be forthcoming. Possibly some of the present writings will 
find their way into such a manual. 



Preview of the Findings 
In the development of these studies certain assumptions have 
become even more firmly embedded in our thinl^ing; 

1. More learning of certain sorts can reduce human need, 

2. More effective learning can be achieved through Improved 
instructional communication, and 

3. To be effective, learning must mal<e significant 
differences in people's lives. 

We have made many observations, in the literature and through 
direct experience in the field. Some of tlie more persistent observa- 
tions, developed in various ways by the authors In this series are the 
following: 

1. Two major functions, to some extent based on contrasting 
and competing needs, have led to the various emphases on 
non-formal education: 

a. Seel<ing for expanded and alternative delivery systems 
(I) to lower costs of education, and (2) to improve 
access to education; 

b. Revising the nature of educational content and Its 
relation to large-scale social needs. 

2. There is a great range of qualitative differences among 
activities that fall into the general category "non- 
formal education," some are effective, some are ineffective. 
Just because an educational experience is non-formal is 

no promise that it will be effective. 

3. An appropriate awareness of teaching and learning is 
arising. Involved In this "new pedagogy" are the 
following factors, some of which are becoming more 
clearly a matter of concern for those studying and 
planning non-formal education: 

a. Recognition that planning of Instructional systems is 
a promising alternative to unplahned pedagogy 
(unplanned pedagogy in non-formal education Is apt 
to reflect little more than the ways and means of 
formal education); 
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b. Recognition of the need to use slightly-trained 
instructional manpower; 

c. Recognition of values of various "mixes" of 
instructional mediation; 

d. Recognition that "motivating people" must give way 
to learning based on motives that reflect functional 
rewards In the society; 

e. Recognition that l<nowlng the learners and accommodating 
their characteristics is the basis of Increased 
effectiveness; and 

f. Awakening of sel f-awareness--expla Inable in terms of 
Piaget's higher stages of cognitive development 
(abstract processes and formal proces5es)--ls the 
most promising single change that characterizes the 
emerging new instructional styles, e.g., Frelre's 
"concientization." 

Studying effective learning as it relates to non-formal 

education is a series of confrontations with various dilemmas. Some 

of the more troublesome dilemmas follow: 

1. Learning research and the most basic literature does not 
explicitly distinguish between learning in formal and non-formal 
learning environments. The distinction between formal and non-formal 
is assumed to be more a matter of the context of learning than of the 
kind or quality of learning. However, since formal education Is both 
the source of research concepts and the locus of most experimental 
studies, it is probable that learning theory relates more adequately 
to formal education than to non-formal education. It Is reasonable, 
nonetheless, to assume that learning Is enhanced in essentially the 
same ways in formal and non-formal education. To some extent, these 
enhancements of learning are more "natural" In non-formal education; 
but we have seen that even in non-formal education the key factors 
that enhance learning may be missingl 

2. If the interest in non-formal education is somewhat 
cynical, it can be said that ministries of education are rising to 
the ba i t : 

a. Thoy are establishing councils for liaison with 
other ministries; 
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b. Thay are effecting legislation or bureaucratic rules 
to gain control of non-formal education} and 

c. Thuy are sponsoring retraining for non-school 
educational personnel. 

Some of the-se efforts are necessary (or at least assumed to be 
the necessary bureaucratic steps to involvement of government In non- 
formal education). But some of the results are not rlearly 
advantageous: 

a. The ministry of education may tend to discourage 
variation; It may become more bureaucratic and be 
seen as a threat to other agencies already engaged 
In r on -forma I education. 

b. A ministry of education tends to structure, absorb, 
and control . 

c. A ministry of education tends to maintain, justify 

and further entrench the existing systems of schooling, 
no matter how firmly avowed is the Intent to be open 
to change. 

There is a real danger in trapping large sectors of humanity In 
a limited sort of education. It is possible that schooling as literacy 
and schooling as formal cognitive processes in abstract reasoning are 
necessary to unlock the higher potentialities in learners. The evidence 
on this issue is not conclusive. The needs of many marginal and 
growth-sector populations Include the need for status provided by the 
formal education structures. This is reflected In the ceremonial and 
symbolic credent la I ing components of the culture. Discarding these 
structures requires radical surgery and endangers the stability of the 
society. Dangers in pragmatic solutions for short-term problems are 
serious; the long-range potentialities for use of the learnings must 
be considered. In these writings, the difference between documenting 
and speculat ing--descr ibing and prescr ibing-- is a continuing Issue of 
discipline. We cannot claim to have made a thoroughly dispassionate 
review of the situation; the reader is thus warned to protect himself 
from the well-intentioned biases of the authors. 

After an immersion of three years in the study of non-formal 
education, its problems and promises, we are prepared to cite a number 
of general conclusions and to offer a series of recommendations: 
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1. The most important factor in designing re-vitalized 
education Is the emphasis on the characteristics of 
target learners in relation to the reward systems within 
which they 1 i ve, 

2. Not all non-formal education is equally effective. Factors 
that seem to make the difference and to accompany quality 
(In terms of effective learning) are reflected In the 
following recommendations: 

a. Every program of non-formal education should Include 
an evaluation component. 

b. Comparative studies should be done across programs of 
non-formal education} programs that knowledgeably draw 
from precedents and which are alert to alternative 
ways of doing things generally are stronger. 

c. Planning and replanning should allow for recycling on 
the basis of formative evaluation; unchangeable 
programs tend to stagnate and degenerate, no matter 
how promising at first. 

3. Alternative delivery systems are more attractive to 
developing nations than are revisions of the content and 
concepts of education. 

a. if alternative delivery systems are to be significant 
doors to progress, planners must be helped to see the 
larger Issues Implicit in the content of education. 

b. Every program of non-formal education should Include a 
content evaluation. 

4. The contemporary emphasis on non-formal education Is not 
Inherently a good thing. 

a. Communicative awareness and sharing, not coordination 
and control should be the goal of any overseeing 
ministry. 

b. A ministry of education should not see Itself as the 
sole agency of noh-formal education. 

c. Experimental programs should be encouraged, especially 
those that deal with alternative content and structure. 



The "Oe-School tng" Undercurrent 

One cannot move very far into the study of learning effective- 
ness in non-formal education before encountering the question, "What's 
wrong with the schools?" If schools were as concerned about effective 
learning as they are with "covering the material," as concerned with 
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helping and as involved with fundamental Issues of society as they are 
with the running of "orderly" institutions, the current debate over 
the validity of schooling would be easier to resolve (indeed It might 
not have becon,e an Issue!). To these problems must be added, in. 
fairness, the matter of the sl^e of the esitabl ishment 5 it is 
important to remember that schools, In the most "advanced" countries, 
are expected to cope with vast numbers of people and to do so for 
twelve and more years for each person. And In these twelve years the 
success of the system Is measured In the same way for the whole mass. 
The management problems associated with supporting such a huge 
operation virtually rule out any serious concern for learning effective- 
ness. 

If there are lessons here for non-formal education, they might 
be drawn from the converse of the schooling dilemma. Rather than 
creating a single complex establishment attempting to serve all the 
needs of all the people, non-formal education would be better advised 
to remain a loose conglomerate of many kinds of resources. In many 
different ways providing an array of educational services. Rather 
than attempting to drag everyone Into and through some arbitrary portion 
of the whole system, non-formal education would attempt to make Its 
resources highly visible and easily accessible. Across the path of 
people's own motivations non-formal education can place ways and means 
that they can recognize, accept, and relate to In order to help them- 
selves. 

With reference to content, non-formal education should be con- 
cerned more with what people can see a need for than for what academic 
traditions have ordained as "fundamental." In the matter of Institu- 
tional structure, overheads of all sorts should be kept low--make 
minimal physical plant Investments (use existing buildings, on the 
job, in the plant. In the neighborhoods and at the roadside)} make few 
administrative hierarchies, keep the ratio of delivery agents to 
administrators very high; keep the training of technicians from 
becoming an over-bearing superstructure; and build programs at a local 
level rather than at a bureaucratic "headquarters" in the capitol. 
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Above all, the classical mistakes, excesses and faulty 
assumptions that are so readily criticized in formal education 
should be recognized and avoided, Thus we encourage planners of 
educational experiences for non-formal education to be careful 
readers of the growing literature on de-schooling, That literature 
Is not extensively treated in these pages, but our findings point to 
some of the same issues. 
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EFFECTIVE LEARNING: LESSONS TO BE 
LEARNED FROM SCHOOL I NQ 



Ted W. Ward 
F. Donald Sawyer 
Lois McKlnney 
John DettonI 



The school teachers . . . 

If an inspector happened to pass by, they could 
put up a better show than we could. The Inspector 
does not venture outside the syllabus. Although 
you know perfectly well, and so does he, that that 
kind of French Is useless. And for whom are you 
doing it? You do it for the . . . Minister of 
Education. That is the most upsetting aspect of 
your school: it lives as an end in itself.»'< 



Worldwide, formal schooling is writhing in an upheaval. In 
America --exemplary of a thoroughly schooled soc lety—cr i t tcs ranging 
the full spectrum of educational philosophies, are finding eager 
audiences for critical and cynical writings. Parents, students and 
educators seem ready to believe the worst. Study after study, volume 
after volume describe in sanguine detail about the alleged bankruptcy 
of the educational entisrprlse envied the world over. In a prosperous 
and Industrialized society such as the United States, continued 
investment in a disfunct ional mode of education is simply an unfor- 
tunate and regrettable misuse of human and material resources; but 
in a less developed nation, it is a disastrous and tragic policy 
leading to national frustration. 

''The Schoolboys of Barblana, Letter to a Teacher , trans, by 
Nora Rossi and Tom Cole (New York: Random House, 1970) , p. 17. 
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The desire of many loss developed countries to achieve the 
same level of economic development, evidenced by an attendent 
cornucopia of material wealth as possessed by the United States, leads 
them to emulate their richer, much envied and idealised neighbor In 
the key area they feel is within their grasp--educat Ion. The situation 
is analogous to the pathetic efforts of a Pacific Cargo Cult hope- 
fully constructing non-functional replicas of airliners and clearing 
landing strips in the jungle to welcome wealth-laden planes from the 
skies, thus expecting to enrich their impoverished islands. Laborious 
and elaborate preparations over, the people wait vainly for the 
arrival of their dreams. So it Is with many of the development hopes 
invested in schooling. 



Problems of Schooling 

As Ivan I Mich points out, for the LDC's (less developed 

countries) to accept the **schooling hoax Is to purchase a ticket for 

the backseat in a bus headed nowhere.** 

More and more, men begin to believe that tn the schooling 
game, the loser gets only what he deserves. The belief In 
the ability of schools to label people correctly Is already 
so strong that people accept their vocational and marital 
fate with a gambler's resignation. In cities this faith tn 
. school -slott ing is on the way to sprouting a more creditable 
mer i tocracy--a state of mind In which each citizen believes 
that he deserves the place assigned to him by school* A 
perfect meritocracy, in which there would be no excuses, Is 
not yet upon us, and I believe it can be avoided. It must 
be avoided, since a perfect meritocracy would not only be 
hel I ish, it would be hel I . 

Educators appeal to the gambling instinct of the entire 
population when they raise money for schools. They advertise 
the jackpot without mentioning the odds. And those odds are 
high indeed for someone who is born brown, poor, or in the 
pampa. In Latin America, no country is prouder of its 
legally obligatory admission-free school system than 
Argentina. Yet only one Argentinean of five thousand born 
into the lov;er half of the population gets as far as the 
un iversi ty . 

What is only a wheel of fortune for an individual is a 
spinning wheel of irreversible underdevelopment for a nation. 
The high cost of schooling turns educaMon into a scarce 
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resource, as poor countries accept that a certain number of 
years in school makes an educated man. More money gets spent 
on fewer people. In poor countries, the school pyramid of 
the rich countries takes on the shape of an obelisk, or a 
rocket. School Inevi tably g ives ind Iv idua I s who attend It 
and then drop out, as well as those who don't make It at all, 
a rationale for their own inferiority. But for poor nations, 
obligatory schooling is a monument to self-inflicted Inferi- 
ority. To buy the schooling hoax is to purchase a ticket for 
the back seat in a bus headed nowhere. 

Schooling encrusts the poorest nations at the bottom of 
the educational bucket. The school systems of Latin America 
are fossilized deposits of a dream begun a century ago. The 
school pyramid is a-building from top to bottom throughout 
Latin America. All countries spend more than 20 percent of 
their national budgets and nearly S percent of their gross 
national product on Its construction. Teachers constitute 
the largest profession, and their children are frequently 
the largest group of students In the upper grades. Funda- 
mental education Is either redefined as the foundation for 
school ing and therefore placed beyond the reach of the 
unschooled and the early dropout, or Is defined as a remedy 
for the unschooled, which will only frustrate him Into 
accepting inferiority. Even the poorest countries continue 
to spend disproportionate sums on graduate school s--gardens 
that ornament the penthouses of skyscrapers built in a slum. 

If the primary tragedy occurs in the attempts of poorer 

countries to imitate a d i sf unct lonal system, then those disfunctions 

can be most readily explored In the mother model Itself. One 

Canadian educator has identified eight Ills of public schooling In 

North America: (1) the emphasis on competition; (2) the misuse of 

educational resources; (3) the misuse of time due to a general 

obsession with sequential curriculum grades, tests, registers and 

administrative details; (^) the general use of coercion, man i5>ulat Ion 

and discipline to fit individual students into a pattern that will 

reflect the teachers', not the students' attitudes toward life, 

education and learning; (5) the neglect of schools In the area of 

social -emot iona I growth; (6) the absurdity of the teacher-versus- 

student relationship; (7) the loss of real, relevant, meaningful 

and rewarding experiences In school; and (8) the belief that the 

classroom and school is the only learning environment available to 

students and teachers. 
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These Issues in a multitude of variations have been 

2 

chronicled in Silberman's Carnegie Commission report and in many 
other recent volumes and articles. Such problems are not restricted, 
however, to the North American scene. In the context of lesser 
developed countries these *Mllnesses'* become national cancers draining 
a nation's strength and resources. In the course of this paper, the 
failures of formal schooling in the American milieu will be examined 
as they manifest themselves in the third world. In so doing, it is 
hoped that a theoretical base will be developed which will suggest 
some directions and principles useful in the creation of an effective, 
non-formal educational system to meet the national needs of countries 
now being failed by rather than being served by formal education. 

In a country with little wealth to begin with, the commitment 
of nearly half of the national budget to an educational system that 
Invests half the educational expenditure on one percent of the school- 
age population, as is the case in Bolivia, is of dubious wisdom. To 
further underscore the imbalanced use of educational funds, lllich 

claims that each of Bolivia's university students receives 1,000 

3 

times the average citizen's share of public expenditures. Yet the 
competitive educational model that gives rise to this meritocracy 
justifies (in the minds of the **f a 1 1 ures that vast majority of 
participants In the schooling game, as well as in the minds of the 
succeeders the legitimacy of these grotesque inequalities. 

The losers are the people; especially the childern of the 
lower classes. 

The typical working class family . . . confers a relative 
disadvantage on its'children with respect to their language 
and cognitive development, which makes it more difficult for 
them to succeed in the primary grades of school, where the 
teacher uses an elaborate language which is much like that 
which the middle-class child has learned in his home.^ 

The passive acceptance of lowly status by those excluded 

(because of social and environmental factors) from the credent ial i ng 

process via the schools, however, is only slightly less tragic than 

the elevating to positions of power those meritocrats who have been 

concerned less with getting along with their fellow students than 
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with getting ahead of them. The lack of concern or understanding 
demonstrated by the leaders and economic elite persons of many LOC's 
for their less fortunate countrymen can be at least In part traced 
to the struggli? for credentials and "superiority" fostered by com- 
petitive schooling; and this struggle does not lead to increasing the 
concern for what is being learned or its relevancy to national needs 
and conditions. Motivation for learning in schooling is commonly 
derived from a fear of academic failure and the consequent entrapment 
by poverty and power lessness . 

While schooling can and does create and reinforce social 
stratification, it has proven remarkably ineffective as a means of 
closing these gaps. Jencks concludes that schools, regardless of 
their quality, the innovat i veness of their programs, or the attitudes 
of their teachers, are largely Incapable of going very far In 
reducing social and economic inequality. 

These findings Imply that school reform Is never likely 
to have any significant effect on the degree of inequality 
among adults. This suggests that the prevalent "factory" 
model, in which schools are seen as places that "produce" 
alumni, probably ought to be abandoned. It Is true that 
schools have "Inputs" and "outputs," and that one of their 
nominal purposes Is to take human "raw material" (i.e., 
children) and convert it Into something more "useful" 
(i.e., employable adults). Our research suggests, however, 
that the character of a school's output depends largely on 
a single input, the characteristics of the entering children. 
Everything else--the school budget. Its policies, the 
characteristics of the teachers--ls either secondary or 
completely Irrelevant, at least so long as the range of 
variation among schools Is as narrow as It seems to be In 
America. 5 

To the extent that Jencks' data can be generalized to situations 
outside the United States, It would appear that LDC's cannot look to 
the formal educational system to provide greater equality of material 
and power distribution or to draw a larger proportion of their popula- 
tion into the dynamic process of nat ion-bul Id Ing. 

Kitchen (I968) in a study of the relationships between socio- 
economic factors and educational output in Newfoundland, the area In 
Canada most similar to the conditions found In most LDC's» found that 
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the *'educat lonal inputs** (teacher salaries and teacher experience) 
had less relationship to **educat ional outputs** (retention, retardation 
and completion) than did many of the socio-economic variables 
examined. For example In the matter of retention, the length of 
time a studi=:nt remained in school was more significantly related to 
six socio-economic factors on one measure and eight on another than 
to any of the educat ional input variables. The four factors most 
prominently related to retention (and this general pattern held 
remarl<ably true for the other measures as well) In rank order were 
(I) percentage of community population illiterate, (2) percentage of 
community population functionally illiterate or illiterate, (3) per- 
centage living in urban centers, and {k) percentage living In rural 
non-farm communities. 

Kitchen concludes, 

h follows from the evidence that attempts at Increasing 
educational output must go beyond the raising of teachers' 
salaries .... The more basic problems of chronic non- 
employment, adult illiteracy, fatalism, and large families 
must be tackled, and ways to counteract their effects upon 
each succeeding generation.^ 

Viewing buildings and resources together, it seems apparent 

that the elaborate structures and facilities of American education 

are out of reach of most less developed countries. But less clear 

is whether this is a detriment or an advantage. The benefit/cost 

ratio of American education is so much under attack that questionable 

schemes such as performance-based contracts, have been desperately 

latched onto by anxious school boards across the country. Obtaining 

tittle in return for enormous expenditures has turned the public into 

an angry camp; mi Mage requests are being voted down time after time. 

Schools operating In old houses, basements and churches--many part- 

t ime--threaten to match and surpass the public schools In the area 

of skill development. As a result of the schools* tendency to grow 

even larger and to hide their operations In forbidding structures 

often set apart physically as well as psychologically from the 

community they are supposed to serve, the education that takes place 

there has become so detached from local needs and conditions and from 
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reality in general that, as Edward Wynne points out, the product is 

largely un integratable and lost to society, at least as a critical, 

capable, aware, mature participant. 

The f^.:'litJs and schools do not intend to prevent these 
children {particularly upper-middle class children) from 
maturing, out they naturally structure and focus the develop- 
ment of the young. The process they apply heavily emphasizes 
in-achool and bool< learning, and systematically shields the 
young from diversified life experiences. This handicaps 
tueir transition from youth to adulthood. The children do 
essentially what iheir parents and their schools want--and 
end up inadequately matured. ^ 

Not only do the fantastic expenditures for educational hard- 
ware in the United States often appear to impede emotional and social 
maturity, but the necftssity or even effectiveness of such expensive 
instructional tools seems questionable as well. Paulo Preire, the 
expatriate Brazilian educator wlio has developed an influential 
approach to literacy and basic community development for Latin 
American adults, states that tlie materials for his program, a slide 
projector and set of slides, costs between $6.00 and $7.00.® With 
these materials 25 people are t lught basic literacy In about two 
months. As in most cases of effective rural or extension education, 
Freire depends not on elaborate, carpeted media centers with 
individual projectors for each student, or on gadgeted reading labs, 
but on identifying the needs of his clients and then using their 
concerns and the resources of the community to provide learning for 
which the target learners see a need. It Is not Prelre's methods, 
in the mechanistic sense, that make his contribution significant, 
but rather his total commitment to the view that what the learner 
values is the important basis for effective learning. 

The misuse of time In American schools Is perhaps the most 

<itriklng Illness of all. As education critic Jonathan Kozal states: 

Twelve yea<*5 of lock step labor In the field of math or 
language arts are manifestly wasteful of a child's learning 
energies and learning hours .... No child who Is not brain- 
injured or otherwise Impeded In his powers of comprehension 
needs six years to learn to write ten sentences with 
reasonable cogency and power. 9 
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And while Freire is a little more modest and allows himself 
forty days, the Chinese now claim to be able to teach basic literacy 
through records and instruction in twenty hours, Reimer cites John 
Gardner, former U.S. Secretary of Health, Education, and Welfare as 
stating that everything now taught in twelve years of schooling could 
be learned in two, or, with a little effort even oneJ^ The time 
spent in activities unrelated to educational activities in most 
schools far exceeds that expended in actual teaching. The custodial 
function of schools becomes predominant and time Is allocated accord- 
ingly--the teacher spends most of his worl<ing hours in bureaucratic 
tasks and maintaining order over his bored, unruly charges. In fact, 
a study conducted in Puerto Rico by Anthony Lauria Indicated that 
less than 20 percent of the teacher's time was available for Instruc- 
tion; the remainder was spent on "behavior control and administrative 

..II 
rout ine." 

It quickly becomes clear to even the most casual observer that 
to be effective, education does not require the tremendous number of 
hours devoted to largely meaningless labor which is required in so 
much of American schooling. 

L i terac y 

Besides the general shortcomings and high cost of formalized 

schooling, the possibility of implementing a system of formal education 

in most LOC's is highly doubtful for a number of reasons relating to 

the particular conditions of the developing nations. For example, 

there are 110 million more illiterate adults in the world today than 
12 

in 1951, and almost all of this increase has occurred in third 
world countries. In many countries the population Is increasing twice 
as fast as the literacy rate. Relying on formal schooling to close 
this gap has proven unsuccessful; instead of narrowing, the gap has 
widened steadily. Formal education has proven incapable of meeting 
the demands made upon it by population increases even in the area to 
which it claims to address itself the most dlrectly--l iteracy . 

For many people, the threshold of opportunity for learning Is 
literacy. Formal education is structured to exclude those who cannot 
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read and write. Thus formal education's first tasl^ Is assumed to be 

development of literacy sl<ills. Aptitude for reading, especially, is 

the predetermination of a child's educational opportunity; learning 

quickly to read well is the royal road to educational advancement and 

to the employment opportunities for which formal education is the 

gate-key. Many intelligent people-- lacking in motivation for formal 

schooling during chi ldhood--are condemned to relatively restricted 

opportunity and ultimate productivity. This is especially serious in 

societies aspiring after the degree-credent iai ing economic-status 

1 3 

system of the colonial tradition. 

Caspar Weinberger, the U.S. Secretary of Health, Education 
and Welfare, in announcing the million in 1973 "Right to Read" 
program grants stated that "Almost 19 million adult Americans are 
totally or functionally illiterate and another seven million elementary 
and secondary school students have severe reading problems." One 
must wonder about one part of the stated objectives of the "Right 
to Read" program: to "eliminate" adult illiteracy. Considering the 
si2e of the problem the idea of "elimination" sounds painfully 
similar to those grandiose claims which so often have led the world 
toward disappointment: "universal educat Ion," "funct ional literacy 
for all" and "free access to schools," to name a few. Even in a 
"developed" nation, formal education had best include alternative 
modes of learning experience; clearly, if two Americans in each 
thirty are functionally illiterate there are many more for whom the 
reading skill is problematic, at best. 

From our snug and smug posture in the "have" nations, it Is 
so easy to see non-formal education as a concern of the "have-not" 
nations--and to extend this faulty view to the matter of literacy. 
People are not more intelligent after they learn to read: illiteracy 
does not mean unreachable, stupid primitives. In certain societies, 
in fact, the skills of aural learning are more highly developed than 
outsiders can imagine. We should learn to "connect" with these 
existing learning skills before we push the new learning skills 
that I iteracy demands. 
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The persistent problem is that people simply do not want to 
waste time reading; by this we describe the majority of the people In 
the world, not some small fragment. When a whole society is organized 
around aural communication, print media can seem to be so unimportant! 
No matter how fond of reading some of us may be, communicating with 
people is a matter of reaching out to where they are and accepting 
them the way they are. That means, for non-formal education, resisting 
the temptation to make literacy a requirement for practical learning 
and human development. 

As people who have been wrestling with the matter of literacy 
and its relationship to effective learning, we urge that the issue be 
kept open; we are sounding the call for rethinking the place of 
literacy in human development. Pragmatically, the problem is that 
so few non-literate people see the value of learning to read and 
write. The mysterious processes of coding and decoding marks on 
paper are remote from the pressing problems of daily survival, and 
even more irrelevant for the typical peasant who has not even grasped 
the vision of participating in the determination of his own destiny. 
At a deeper level, the issue Is to decide at what point and for what 
purposes literacy will be seen as important by the learners, and to 
use non-1 iteracy-based procedures up until that point. 

Unless LDC's can break out of the "literacy first" perception 

of education, they are dooming huge percenteges, and often increasing 

numbers, of their citizens to continued ignorance, power lessness and 

poverty. As a recent report on education In Ethiopia declares, 

. . . prior literacy skills must not be made a pre- 
condition to further education. The implication is th'»t 
means must be found of providing education for the 
illiterate. Hi's education must begin and proceed for 
some time--maybe indef ini tely--wl thout the benefit of 
the skills of reading and writing. '5 
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Out -"of "School Youth: The Isj^ue 
Is Pract i ca l I ty 

Possibly more damaging than the failure? of formal education 
to meet literacy demands is its inability to relate to the needs of 
those with "low IQ*' or of *'low schoolabt I i ty .** This failure has 
dealt a decisive blow to many nations* hopes of social development. 
Instead of creative programs designed to Identify and work from 
the concrete conditions of the clients and devising means of by- 
passing Illiteracy or the i r c I ients * inability to deal with abstract 
concepts, most LOC's have continued to rely primarily on traditional 
schooling concepts with its destructive selection process. 

The assumption that a national educational program can reach 
only those who have achieved a level of functional literacy is both 
impractical and ineffectual. Despite the massive expenditures for 
schools and related expenses that occasionally claim over 1/3 of a 
nation*s total budget, indications are that the absolute number of 
students not receiving a basic education will continue to rise In 
many countries. A recent report by UNESCO^^ on out-of -school youth 
in Asia revealed that out of ^33 million young people (aged 6-I8) in 
thirteen countries studied, 255 million or 52 percent will not be In 

school by I98O. This means they are projecting an Increase In the 

« ' 

number of out-of-school youth in these countries of over 58 million 

in less than a decade. The study also suggests that in at least 

four countries, India. Pal^istan, Iran and Indonesia, ^0 percent or 

more of those children aged 6 to 12 will be out of school by 1980» 

In Pal<istan this figure is expected to be around 68 percent. Similar 

figures for Latin America are also available: In I960, half of the 

children who entered 'school in Latin America never reached second 

grade and half of the second graders never made It to third* Three- 

1 7 

fourths dropped out before learning to read* 

Give me a f ish 

and I eat for a day. 

Teach me to fish 

and I eat for a I ifet ime. 

. . . foll< proverb 
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Providing education lias tlius been ideal i7ed as an alternative 
to giving gifts. Providing means of self-help has been ascribed more 
value than providing direct assistance or "welfare" contributions. 

As education becomes less directly Involved with fishing, 
with eating, or, in fact, with anything directly and obviously 
related to living a more satisfactory life, education Is said to 
have become formal. In such a condition, education Is serving 
formalized pruposes and performing traditional roles } whether or not 
these purposes and roles are functional or pragmatically valuable has 
become a remote consideration. 

The nomenclature of formal education makes a distinction 
between education and training , typically placing a premium on 
education and at the same time stigmatizing training. Even as train- 
ing is better than giving, so education is better than tralnlng-- 
according to. the value system of formal education In this technological 
nation. Education (and by this is usually Indicated the great 
amorphous totality of Induced learning In a person's life) Is the 
key to full and rich living. Never mind that it is also the Induction 
to a life of competitive grasping after acquisitions, additives, 
resource-squandering and unnatural alternatives to what Is otherwise 
one's lot and station in life! On the other hand, training is crass 
and mundane because it is temporal (ad hoc), practical and, by 
inference, non-intellectual. This distinction, untenable though It 
may be, has found its way into the thinking about values of education 
in much of the wor ld--especial ly that part heavily Influenced by 
American patterns. The current excitement about non-formal education 
In the developing nations suggests that the distinction between 
education and training is undergoing change. After years of eager 
emulation of the Western world's ladder-pyramid style of formal 
education, practical I earn ing--and what In earlier terminology would 
have been called "training"-- is suddenly acceptable and respectable. 
It is now called non-formal education I 

Perhaps this oversimplified extension of the ()roverb cited 
above characterizes the essence of the new awareness: 
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Educate me in ichthyology 

and I may someday eat-- 

-•if I find a job as an ichthyologist 
(or as a professor) 

Teach me to fish (even If non-formal I y) 
and I eat today ! 

Adult Learning 

The dream of universal schooling Is far in the future, If 
realizable at all. Large percentages of the populations of many 
countries will continue to live, learn and work In societies without 
the benefit of "functional" or even "basic" literacy. If an educa- 
tional system devised to meet national needs cannot develop methods 
for reaching, motivating, and enabling its clients, literate or 
illiterate, to affect their environment. It will probably enjoy only 
I imi ted success. 

There are clear Indications how such a program should be con- 
structed. First, such a program must be capable of accurately 
assessing the learning style preferences and the developmental levels 
of the clients and then be flexible enough to adjust to their stage 
of cognitive development. Schools have proven notoriously Incapable 
of adjusting to differences in learning styles and have effectively 
excluded those unable to cope successfully with the abstract, complex 
mental operations that schools assume to be basic to the most valuable 
learning experiences. 

The non-schooled adult is not always unlearned or uneducated. 
L^rge amounts of l<nowledge relating to social and economic life have 
been learned through word-of-mouth transmission and through modeling, 
iiocial roles, agricultural and construction skills, crafts, history, 
language, and so forth, are passed on from generation to generation 
through an informal but often highly refined system of Informal 
learning. Whether the learning takes place through Informal tutoring, 
supervised on-the-job training, apprenticeship or by listening to 
stories and legends recounted by elders, the Informally learned 
individual Is primarily discovery-Oriented and is usually operating 
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at a concrete level of mental operations. In other words, the Informal 
learner Is e;<posed to and searches out answers to concrete problems 
such as those confronted In agriculture, irrigation, hunting, etc. 
Success, and the consequent reinforcement and retention of learning, 
is perceived not by abstract rewards such as grades or credentials, 
but by very real and immediate rewards such as physical health and 
survival and social well-being, The material, skills and concepts 
being learned relate directly and intimately to the concrete reality 
of the learner's world. Thus the Informally learned person, In 
contrast with the formally learned person, would seem to be more 
discovery-oriented, more an organic, holistic learner operating at a 
concrete level of cognitive process, 

Where this is the case. It would seem probable that Informally 
learned persons, especially those who have relatively low literacy 
skills and levels of modernity, would have a natural learning style 
that is inconsistent with the pedagogical style of the formally con- 
structed educational system. Lacking an educational process which 
will reach him at his level, the informally learned Individual will 
almost certainly experience a high degree of frustration and failure 
In the schools and will either opt out or be shut out of the formally- 
sanctioned schooling system. In effect, he will be excluded from 
access to social credentials and relegated to personal poverty, 
powerlessness , and social unproductiveness. 

Piaget's Contribution to Understanding 
Effect iv'} Learning 

The need to reach people at this level of intellectual 
operation is extremely important in a successful non-formal educa- 
tional program. Piaget's work in cogn i t ive development relates 
directly to this problem and provides some significant implications 
for educational systems attempting to reach non-schooled adults. 

Plaget finds that the human organism, through the biological 
functions of assimilation and accommodation, acquires Increasingly 
complex cognitive structures during successive periods of growth. 
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As the person develops, dl rect act Ions pave the way for concrete 
operations, and concrete ope rat ions in turn enable formal (or propo- 
sltional) operat ions--the ability to deal with abstract concepts and 
to act upon concrete operations. Each stage grows out of and at 
the same time is different from the stage which it supercedes. 

Of the four stages which Piaget Identifies, sensor I -motor, 
pre-operat ional , concrete operations, and formal or propos I t lonal , 
there is considerable evidence that, as already suggested, most non- 
schooled adults have not yet entered the "formal operations'* stage 

1 8 

and are functioning at the concrete level. Both Goodnow and 
1 9 

Greenfield found that without schooling adults perform little 
better on Piaget*s tasks than do nine-year olds. Apparently 
schooling, or at least the l<ind of environment provided through 
schooling, creates conditions necessary for breaking up the concrete 
operational structures and building upon them with them, and In 
their place, the more complex structures of the formal (propos i t lonal ) 
operations period. 

What role does schooling have In developing formal operations? 
Two answers to this question have been suggested. First, school 
requires working "In your head." Both Goodnow and Greenfield 
observed that unschooled children rely more on external perceptual 
cues than do schooled children. Unschooled children learn by 
moving things and observing patterns. School experience promotes a 
shift to Internalized modes of problem solving. It calls for 
thinking without immediate perceptual cues. It calls for thinking 
before acting. Goodnow notes that the four features of schooling 
mentioned by Bruner (that one adult is prominent, that the context 
is not immediate action, that imitation is less easy, and that word^ 
are a prime medium of instruction) all call for abstraction. She 
believe? this fact accounts for the generally better performance of 
school children on tasks demanding non-motor representations. 

Goodnow goes a step further in her discussion by suggesting 
that "school" is a crude and over-simplistic varlablei and that we 
should consider alternatives to the "school lng--no schooling" variable. 
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Piaget voices a similar opinion tliat "general operations depend tess 

on school Clian on tlie activities of children or ... on the adult 

20 

stimulations in the environment." 

If we find that non-schooled adults are operating at a 
concrete level, as revealed by performance on several Piagetian tasl<s, 
what would this mean in terms of the education process? 

First, it would mean that we should communicate as concretely 
as possible, using illustrations from life situations with which 
adults are familiar, and for which they thus have readily available 
mental images. It would also mean using drawings, pictures, and 
tangible models, to present materials graphically and through the 
senses. 

In addition, planning to communicate on the "concrete opera- 
tions" level would mean providing ample opportunity for the learners 
to learn actively by manipulating their environment. We would provide 
for direct, on-the-job experiences wherever possible, legitimatizing 
the home, the field, or the factory as places to learn. 

Further, since we are worl<ing with adults, and we assume 
that there is not a physiological basis for their development being 
arrested at the concrete stage, a {knowledge of where these learners 
are and where they can go would mal<e it possible to introduce system- 
atically a series of experiences designed to develop their cognitive 
abilities and potentialities. We would create environmental conditions 
in which they would be encouraged to consider alternative solutions 
to problems, to manipulate some variables in their surroundings while 
they control others, and to engage in other complex behaviors 
associated with prepositional thinl<ing. Perceptual and motor supports 
for their actions would be systematically reduced over time. Because 
of the maturity and experience which adults bring to the learning 
situation, it is conceivable that a relatively short and intense 
educational program could bring them into the "formal operations" 
stage of development. Piaget has provided a theoretical framewori< 
for this undertaking; cross-cultural educators would need to develop 
the curriculum. 
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tt could we)) be that a curr)cu)um buDt so))d)y upon the 
know)edge Plaget has given us about how peop)e think wouid prove to 
be more efficient and effective than many current deve)opment educa- 
tion programs which are pooriy attuned to the cognitive structures 
and styles of the learners they are trying to reach. There Is an 
overwhelming need to raise the educational level of adult populations 
In developing societies. Piaget's findings, applied to the special- 
ized communication we call teaching, might go a long way In supplying 
the answer. 

It is interesting to note that Freire's pedagogy, based on 

the concept of "consc lent Izat iOn," bears a striking resemblance to 

the transition from Piaget's concrete stage of mental operation to the 

formal or concrete level of operation. Rather than being bound by 

the mere ability to manipulate objects, Freire emphasizes the need for 

the learner to comprehend his culture and his ability to work upon 

his environment rather than being constrained by Its mythologlzed 

immutability. Consc lent izat ion goes beyond the process of simply 

apprehending reality and helps the learner to "transform the world 

through man's reflection on himself and the world" and to take direct, 

considered action upon them. Freire explains the process as follows: 

The archaeology of consciousness Implies only to Invite 
men who are at the naive level of their consciousness, 
ideologized in a concrete reality In which they cannot 
express themselves, they cannot express the word, they 
don't know that they can know ! To Invite them In order to 
discover that- it Is possible for them to know precisely 
because men can know that they are knowlng.zl 

Piaget's formal or propos Itlonal period has been described In 
remarkably simitar terms. At this stage (the concrete or propos I tlonat) 
the learner becomes free of the concrete. He Is able to perform 
operations upon the concrete operations. He can look at his own 
thinking, and his own ways of solving problems. He develops an 
understanding of chance and of the laws of probability. He can 
deduce what might be from what is. 

The correlation between these two systems of thought, one 
developing out of extensive experimentation and observation of children 
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and the other from work with rural adult illiterates in Brazil and 
Chile, seems highly significant. From contrasting parts of the world, 
under dissimilar situations and on the basis of work with subjects of 
widely divergent ages and cultural backgrounds, highly complementary 
findings have emerged. Any attempt to develop a meaningful and 
effective system of education, particularly one designed to reach 
unschooled adults, should carefully consider the educational Impl Ica^ 
tlons of these findings. 

Havighurst*s Basis for Effective Learning 

Another aspect of developmental psychology also seems to have 

direct relevance to the establishment of an effective non-formal 

education system. Just as Piaget theorizes that the human organism 

evolves through a series of cognitive stages, Havlghurst hypothesizes 

that humans also pass through a series of social or developmental 

stages wherein the individual confronts soda) as well as cognitive 

tasks. The importance of Havighurst's theses lies not so much In the 

universality of certain general developmental tasks, but In their 

capacity to analyze the socio-economic factors, Including school, that 

assist or retard the successful completion of specific tasks* 

A developmental task is a task which arises at or about a 
. certain period in the life of the individual, successful 
achievement of which leads to his happiness and to success 
with later tasks, while failure leads to unhappiness in the 
individual, disapproval by the society, and difficulty with 
later tasks. 22 

Thus the specific tasks confronted by the individual are 
defined largely by the social system in which the individual finds 
himself. The reward system that determines success and administers 
failure is therefore a reflection of the dominant value system, 
generally reflecting the standards of the social elite, and methodi- 
cally discriminating against those from lower socio-economic groups 
and minority cultures. As the schoolboys of Barbiana poignantly 
observe, schools sometimes serve the basest functions in the social 
system: 
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Cockney is not very different, but to speak It Is to be 
marked. The English don't fail students In their schools* 
They divert them toward schools of lower quality* In school, 
then, the poor perfect the art of speaking badly, while the 
rich keep polishing their language* They can toll from the 
way a man speaks whether he is rich and what kind of work 
his father does. Comes the revolution, they can disembowel 
each other with ea!t.e.23 

While Havighurst applies his theories almost entirely to the 
U.S. situation, many of his general observations seem equally valid 
in other cultural contexts. For example, in his section on ''Develop- 
mental Tasks of Infancy and Early Childhood," Havighurst makes the 
following comments that are as true for the poor of most developing 
nations as for the lower classes of the United States* 

The human mind literally grows on the basis of the 
language environment provided for it during the preschool 
years. Psychologists have found a major difference In the 
''diet'' of language given to children of middle-class and 
upper-class homes, on the one hand, and the much less rich 
language diet which most working-class children receive in 
their homes. Parents with above-average education and social 
status use a conversational language that is more complex 
than the language used by parents with below-average educa- 
tion and social status. The "elaborate" language of the 
middle*class home consists of longer and more complex 
sentences, a wider vocabulary, and more adverbs and 
adjectives than the "restricted" language of the typical 
working-class home . . . and middle-class parents are more 
likely to read to and with young children. Thus there Is a 
"family factor" in the language and cognitive development of 
the child which is closely related to the social class of the 
fami I y . 

The typical working-class family thus confers a relative 
disadvantage on its children with respect to their language 
and cognitive developrnent , which makes It more difficult for 
them to succeed in the primary grades of school, where the 
teacher uses an elaborate language which Is much like that 
which the middle-class child has learned In his home*24 

Havighurst goes on to outline a lifetime of developmental tasks 

which is specifically significant because of the relationship he draws 

between the tasks being confronted by the student and the role of 

the school in helping the individual to complete these tasks. In most 

cases Havighurst finds that schools have operated largely at the 

expense of $tudet«ts' social and emotional growth. Schools have, for 
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the most part, ignored the levels of individual development and the 
nature of the learning tasks the student is facing. Little attention 
has been given to differentiations in rates of biological development 
while cultural differences have been all but ignored. Schooling has 
become a sequential series of tasks developed outside of the student 
and Imposed upon him, complete with its own standardized objectives. 
The student's options have been either to conform to the demands of 
the school --whether or not the activities conformed to his level of 
psychological or social development--or to opt out of the system 
altogether. In some countries "opt out" means leaving; In others It 
may include the possibility of stayin.j in physically but not mentally. 

Havighurst further implies that many. times the real develop- 
mental tasks being confronted by students are actually made more 
difficult by the rigid, insensitive nature of the classroom. When 
these tasks are accomplished (socialization, for example) it is often 
In spite of the school environment rather than having been facilitated 
by It. 

While many of the details of Havighurst 's theory may be 
disputed, his fundamental message is clear and convincing— to be 
truly effective an educational system must be able to Identify the 
developmental tasks being confronted by Its students and be able to 
create programs to assist them in their efforts. Implicit in this is 
an understanding of the tasks and problems resulting from different 
socio-economic backgrounds. 

It is clearly absurd to expect a AO-year-old Illiterate 
peasant to possess the same cognitive processes and to have the same 
needs and concerns as a child of an urban, middle class family. Yet 
this has been precisely the assumption upon which most formal educa- 
tion systems have operated. There has been little effort to assess 
the needs of the clients or to offer optional learning situations. 
Formal education has been largely Ineffective In meeting the demands 
for alternative learning styles; it has shown itself capable of 
serving only those segments of society who can emotionally, cul«"jrally, 
psychologically and pedagogical ly conform to its demands. 



00041 



3^ 



If "effective learning takes place when educational opportunity 

25 

Intersects with vital dally concern," then formal education, with 
Its Inflexible programs of pre-determined curriculum, locl^-step 
labor, use of arbitrary time blocks, teacher or "depositor" centered- 
ness, and use of the control model for classroom management, seems 
highly unlikely to provide much "effective learning" on a broad scale. 



Human Needs as the Basis of 
"Learning Effectiveness 

Learning does not have to be coerced or artificially rein- 
forced. Maslow asserts that behavior is motivated primarily by the 
desire for fulfillment of perceived needs. Bruner states that in 
regard to learning, these needs are intrinsic, and provide constant, 
universal motivation for learning that needs only to be perceived and 
tapped into by the educator. 

The will to learn is an intrinsic motive, one that finds 
both its source and reward in its own exercise. The will to 
learn becomes a 'problem' only under specialized circumstances 
like those of a school where a curriculum is set, the students 
confined, and a path fixed. The problem exists not so much in 
learning itself, but in the fact that what, the school imposes 
fails to enlist the natural energies that sustain spontaneous 
learning--curloslty, a desire for competence, aspiration to 
emulate a model, and a deep-sensed commitment to the web of 
social reciprocity .... 

External reinforcement may indeed get a particular act 
going and even lead to its repetition, but it does not nourish, 
reliably, the long course of learning by which man slowly 
builds in his own way a serviceable model of what the world is 
and what it can be.2o , 

Non-formal education, on the other hand, is in a far better 

position to respond to the needs and situation of the individual 

learner, and thus to motivate. Non-formal education is largely 

volunt^sry, in that the individual is not coerced into participating 

but rarher ^ees a concrete benefit accruing from his participation. 

Unlike the school, participants are drawn to nonformal programs 

because they are offered a desirable skill or direct assistance In 

rel'^tion to their attempts to better understand themselves and their 

world. If the education offered Is of no value to the learner's life 
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or does not better equip him to deal with the tasks he Is confronting, 
he will simply refuse to participate further and the program wMI die 
or be obliged to become more meaningful. 

Much non^formal education Is a response to needs and 
articulated desires. To a greater extent than in formal education It 
relies on Its clients to Initiate programs and to determine objectives. 
Thus, by Its nature non-formal education can be flexible In pedagogy 
and content. It Is not usually bound by certification requirements 
or other restrictions which limit the facilitator's ability to respond 
to the changing needs of the clients. Non-formal programs can and 
must change depending on the local situation and the develo^ental 
level of the cl ientele. 

Learner's Views of Themselves 
Formal education's insistence on uniformity of operation and 
performance has a negative effect on the self-esteem of the unsuccess- 
ful participant. This reduced self-concept virtually insures con- 
tinued failure in the schooling game. As Brookover et ai. (1967) 
found, ". . . self concept of academic ability Is significantly cor- 
related with school achievement. Self-concept accounts for a signifi- 
cant portion of achievement Independent of measured Intelligence, 

socio-economic status, educational aspirations, and the expectations 

27 

of family, friends, and teachers." ' Although not all who have a high 
self-concept have high achievement, those who have a high achievement 
have a high self-concept. "Practically none of the students with low 
self-concepts of ability achieved at a high level." 

In Coleman's widely discussed study of educational equality 
(1966), three variables were most strongly associated with achievementi 
(0 student's self-concept, (2) high Interest In school and learning, 
and (3) sense of control of his environment. And while these vari- ■ 
ables "accounted for more of the variation in achievement than any 
other set of variables (all family background variables together, or 
all school variables together 'i,"^^ they arc closely related to the 
socio-economic status of the learner. 
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Coleman and Brookover for example, found a significant 
correlation between a student's sense of control over his environment 
and actual academic achievement for all racial and socio-economic- 
status (SES) groups. Coleman concludes that 

... a different sort of predlsposit lonal factors are 
operating to create low or high achievement for children from 
disadvantaged groups than for advantaged groups. For children 
from advantaged groups, achievement or lack of It appears 
closely related to their self-concept; what they believe 
about themselves. For children from disadvantaged groups 
achievement or lack of achievement appears closely related 
to what they believe about their environments Whether they 
believe the environment will respond to reasonable efforts, 
or whether they believe It is Instead merely random or 
immovable .... It appears that children from advantaged 
groups assume that the environment will respond if they are 
able enough to affect it; children from disadvantaged groups , 
do not make this assumption, but assume in many cases that 
nothing they will do can affect the environment— 1 t will give 
benefits or withhold them but not as a consequence of their 
own act ions. 32 

This fatalism and feeling of impotence is a product of an 

environment that oppresses the individual Into a state of helplessness 

and hopelessness, a condition that is reinforced by schools that under 

score the existing feelings of low self-esteem and Inefflcacy. And, 

given the language and cultural backgrounds of most poor, lower 

socio-economic-status students, there Is little doubt that such 

feelings of low self-concept and impot'^nce will indeed be present and 

reinforced. As Shrank found in his study of self-fulfilling prophecy 

when individuals were randomly assigned to achievement groups in 

simulated classes with ability level designations, 

... a pupil placed In a lower-label ability group for 
any reason whatever is handicapped for as long as he remains 
In that group, and a pupil placed in a higher-label ability 
group is provided unfair preferential treatment. 33 

Amarjit Singh (1972) In his cross-cultural study of Brookover' 

theories of self-concept of ability and school achievement, offers 

some important conclusions. 
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If schools were to be designed on the basis of the 
theory and findings of this research and related researcht 
curricula and programs, the rei>ources of communltyi family t 
and schools would be geared towards enhancing the self" 
concept of ability of all children. 

The main function of schools will not be sorting and 
labeling students and putting the round pegs In round holes 
by using the assumed criterion that learning ability among 
students Is differentially distributed due to inborn dif" 
ferences. Early selection, grouping and streaming practices 
based upon assumed level of fixed ability would not i>e 
practiced in schools. The task of educators would be to 
create conditions which would facilitate the process of self* 
concept enhancement as early as possible and to exercise 
Judicious surveillance. 

The social responsibility of schools would be to increase 
the 'collective ability level' of the students and, ultimately 
all of society. 

The self-fulfilling prophesies that perpetuate social 
Inequalities through schools by means of selection and other 
processes would be analyzed In the light of contemporary 
demand for social equality and social justice in the dis- 
tribution of social rewards. 3*» 



The Search for Alternatives 

Plaget, Freire, Havlghurst, Coleman, Brookover and literally 
hundreds of other psychologists* educators, sociologists, and 
philosophers have Indicated clearly where education should be and 
where, Instead, It wallows In inefficiency, crusty rigidity and 
stubbornness. Most of these critics advocate changes of the existing 
educational system and there Is ample evidence of the need for 
dramatic efforts In this area. There are two sorts of alternatives 
to be sought: the first and most historically venerable Is the 
improvement of the schooling establishment Itself. While not at all 
a new or untried Idea, Its past record of relatively low success does 
not Inspire confidence. The second sort of alternative to schooling 
as it Is known today lies In the development of resources for learning 
outside the school. The concept may be new, but the entitles and 
programs it embraces are as old as education Itself. Indeed the only 
thing new about the field is the term "non-formal education!" 
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Non«forma1 education, especially if viewed as a set of alterna* 
tives to the formal systems of education, offers a way to devise an 
effective approach to learning and education, To enhance learning 
effectiveness, non-formal education must avoid the pitfalls of formal 
education, meet the growing needs of LOC's for i.ivolving their 
citizenry in the critical porcess of nation-building, and incorporate 
the wisdom and findings of contemporary educational critics. 

While certainly not a panacea, non-formal education has 
tremendous potential and promise. Where formal education illustrates, 
by inference, where education could be, non-formal education is, to a 
great degree, already there. The legitimacy of schools is based upon 
their role as credential ing agencies while non-formal education will 
derive its legitimacy only from its ability to meet real social 
needs. 

Most school critics, in one way or another, assail formal 
education for its inability to identify and satisfy the real needs of 
Its cl ients--al 1 of its clients not just the narrow elite It all too 
often serves exclusively. Non-formal education, on the other hand, 
starts from the assumption that effectiveness necessitates perceiving 
and meeting actual needs the people, including the old, the poor, the 
illiterate, and the unschooled. In fact non-formal educational programs 
include those rare efforts seriously dealing with the problem of 
reaching the masses of people rejected as "unsuitable" by the schools 
and those who are too old or too poor to participate in the schooling 
game. 

• 

Defining Non-Formal Education 
A comprehensive and standard definition of non-formal education 
is not yet available in common usage. Perhaps such a definition will 
not emerge until after much more study of the educational issues and 
potentialities inherent In the variety of experiences now called non- 
formal education has been done. The implied and real distinctions 
between formal and non-formal education should be seen within a 
systematic and holistic view of education. It seems useful at present 
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to provide a tentative definition of our usage of the term "non-formal 
education," in order better to Identify our current view among the 
many variations, Whether or not the term "non-formal education" Is 
viable In the long run, It Is useful now to highlight alternatives to 
formal. Institutionalized, educational enterprises. To use such a 
term Is an honest yet unfulfilled attempt to distinguish among the 
major educative forces In a society. 

Virtually all uses of the distinction between formal and non- 
formal education seem defective. The distinctions seem too arbitrary 
to be supportable as part of a coherent theory. The formal/non- formal 
distinction Is at best a sub-division of some larger construct. The 
problem up until now Is that non-formal education has been relatively 
undefined because the non-school sector of education has been of 
little interest and concern to educational planners. Thus, though we 
now need a term to designate this large and sprawled sector of educa- 
tive resources and operations, the best distinction we can make is 
arbitrary and disjunct from systematic theory.. 

Taking the largest possible view, we see that educational 
operations function within the context of a society; and since a 
society, through its educational enterprises, creates formal and non- 
formal educational Institutions, we can examine the whole function of 
education for a given society. By focusing on the gross categories 
of educational functions, we may be able to see what Is formal and 
what is non-formal within education. Figure 1 attempts to do this. 
This figures Is a generalization drawn from the anthropological view 
of institutions and their sources of authority. 

Sources of Authority Is dichotomized Into two codes that 
govern the social mandates (authorizations) of education. Norms are 
the Informal soclo-cultural codes. Policy, on the other hand, is the 
formally structured and superintended Instituting of education by 
some formal authority In the society. (This could be anyone from the 
local teacher to the national minister of education.) In contrast, 
the family, neighborhood and peers educate the child or the new comer 
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Figure I . --Educat Ive Functions In a Society as Reflecting Methods of 
Instruction and Sources of Authority. 

towards informal goals and by informal means through extra-legal 
authority (namely, social norms). 

Methods of Instruction Is dichotomized Into overt and covert, 
indicating the extent to which del Iberateness is reflected in discrete 
identifiable and obvious procedures in executing the educative 
functions. Overt procedures are the easily Identifiable and 
structured modes used by society's institutions to teach. Covert 
procedures are the more subtle, enculturattng process--the "caught" 
teachings presented to each learner throughout his lifetime by all 
the functions of his society. For example, the family rarely uses 
overt modes to teach the skills of speaking the mother tongue; the 
school rarely uses anything other than overt modes to teach a second 
language, yet it may use only covert modes to reinforce and enrich the 
fluency of mother-tongue speech. 
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No function of society falls exclusively into any one of tlie 
cells of tills chart. In various realms and on various occasions 
school, family, religious orders, government and community exercise 
the authority of norms or the authority of policy and instruct in 
covert and overt ways. The usefulness of the chart is more in its 
raising of productive questions, e.g., when does the family employ 
overt modes? On what educative matters does the church establish 
policy? In what matters Is the school operating in covert modes? 

The formal/non-formal distinction now gains perspective: as 
typically used the term "non-formal education" indicates an arbitrary 
sub-division Of the authority-by-policy sectors (cells 3 and 4). The 
distinction is made (as suggested above) in terms of the administra- 
tive structure, style, and labeling of the agency. Note that "non- 
formal education" does not ordinarily apply to the authorl ty-by-norms 
sectors I and 2. (Sectors I and 2 are the arena of socialization 
and enculturation which are more correctly called "informal.") 

Elementary and secondary schools, as well as colleges and 
universities, are primarily engaged in eel 1 k operat ions, and since 
they are formally designated as "schools," they can be considered 
eel I ^b operat ions. But note: the school also operates In. covert 
ways to carry out both policy and norm-authorized learning (cells 3 
and I). Schools infrequently engage in eel 1 2 operations, for the 
important reason that schools, as formal institutions have their 
authority in policyj when a schooi overtly educates, the authority is 
that of policy. For example, a local school may impose an informal 
community standard of conduct or dress. But in doing so, the school 
makes it a matter of policy, e.g., "dress codes, and conduct policies." 

in Figure 2, education within a society is viewed from 
another perspective in order to provide an additional clarification. 
A "where/how" view of instruction is the focus of the concept. One 
continuum is "where" instruction occurs, i.e., the setting. It asl<s 
whether the setting is more flexible or less flexible. 
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Figure 2. --Educative Function In a Society as Reflecting the Settings 
and Modes of Instruction. 



Setting . A less flexible setting Is one In which the environ- 
ment places a great deal of constraints upon the learner. It Is a 
setting where people assemble to learn under the constraint of that 
environment. Usually the less flexible learning environment Is fairly 
rigid and exacting. A more flexible setting Is the learning environ- 
ment more characteristic of out-of-school learning. It Is character- 
ized by fluidity and lack of narrow constraints on behavior and 
subject matter. For example, the school classroom Is a less flexible 
environment and the school playground a more flexible one* 

Modes . The second continuum Is "how" the Instruction occurs. 
It asks the question whether the Instruction Is Informal or planned. 
The Informal mode Is casual, based upon social norms. This mode can 
be found In either the more flexible or the less flexible setting. 
In contrast, the planned mode Is a systematic attempt to Instruct, 
based upon some sort of educational policy. It has a programmatic 
sequence and approach to what Is taught. It, too, can be found In 
either setting. 

The distinction here between Informal and planned modes 
allows us then to draw a four-fold table and makes the formal/non- 
formal distinction easier to see than does Figure 1. These distinc- 
tions also suggest that from a social anthropological viewpoint, we 
have mapped the differences between education that occurs within a 
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formal Institution and education that occurs in the remainder of a 
society's Institutions, The processes of socialization or encultura- 
tlon Include the casual handing down of l<nowledge, sl<llls, and 
attitudes In flexible environments In order to bring people into a 
culture, When these casual things are done In fixed or determined 
ways, It Is generally thought of as schooling. Schooling in this 
aspect, can be seen to be part of socialization. The school has an 
effect because it exists. It has an effect even beyond Its 
structured curriculum. A number of people writing in the field of 
curriculum since the decade of the 1930's, have been pointing out 
that there is often a great distinction between what the school 
thinks it is d«. Ing and what it is really doing! (This distinction 
concerns outputs of the school that may or may not be antithetical to 
its stated goals,) School in,, in the sense that It operates casually 
(imposing norms) is socialization; in the sense that it operates in 
a structured way it can be said to be formalization. The curriculum 
is formal, but the school teaches far more than it admits to its 
curriculum! 

Non-Formal Education as Extension . For some of us the most 
Intriguing cell in Figure 2 is the more flexible approach to planned 

— i-ns-truction which is labeled ''extenslonJL„ (''Extension,'' in this „ 

diagram, is virtually equivalent to the term "non-formal.") In 
deliberately planned non-formal education, the motive is to take 
education to the people. This sort of extension is happening In the 
sidewalk colleges. It is happening overseas In church-related 
operations such as the extension theological education movement. 
These are exciting efforts to bring educational opportunities closer 
to the people and to open more alternatives to formal schooling 
experiences. In doing so, the movement is toward a more flexible 
environment, and in some cases, toward a more casual mode. 

From Figures 1 and 2 we can arrive at a tentative understanding 
of the major elements that go into a definition of non-formal educa- 
tion. These are as follows: (1) authority for content is based on 
policy; (2) both covert and overt procedures and methods are used; 
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(3) Instruction Is planned, systematic and follows some sort of 
organized program; and (M It occurs In a more flexible setting. If 
we put these all together we arrive at this tentative definition: 
Non' formal education is a planned instructional design which uses 
both overt and covert procedures in a more fiexiWe environment to 
teach towards a goal determined by a regulated policy authorized by 
an institution of that society t 

Non-formal education focuses on practical, functional, and 
often, work and job-related education. This distinction can be seen 
in Figures 1 and 2. A primary value reflected In most non-formal 
education Is the Immediate usefulness of education. In terms of 
personal growth and occupat ional enhancement. A second predominant 
value is person-centeredness . Since those who are engaged In non- 
formal education are usually keenly aware of the practical and 
immediately useful goals for their educational experiences, they tend 
to center the Instructional approach on the particular or categorical 
needs of their learners. In other words, non-formal education is 
need-centered. Particular content Is determined by Identified student 
needs. A third element is that often there Is no certification of the 
instructional staff. As often as not, the teachers are those who 
themselves have mastered the cogn 1 1 i ve-af feet 1 ve-psychomotor skills 
involved but do not have formaPaccredltatlon, at^l^ In the 

sense that accreditation is used In the area of formal education to 
signify eligibility by virtue of a particular amount of formal 
educat ion . 

Relationship of Formal and Non-Formal 
Educat ion 

Non-formal education seems difficult to define and to con- 
ceptualize except In juxtaposition to formal education. This Is 
unfortunate since It may connote antithesis. Rather there are 
several positive relationships which point to synthesis. 

First, It Is becoming obvious that few If any of the 
developing countries are wealthy enough to support two major national 
and competitive educational schemes, especially If they are in 
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conflict. To do so would debilitdte both personnel and financial 
resources and would tend to divide the country's resources than to 
unite them. It is, much more intelligent to consider a single, 
workable educational program rather than to seek to build new or 
enhance alternative educational programs. Interestingly, there are 
a number of non-formal alternatives already showing themselves In 
many countries. The question then is what to do with them: allow 
them to continue to develop as competitive, alternative systems; 
repress them; adapt the formal educational institutions for the 
formal model; or integrate the whole into a broader concept and plan 
for educational development? 

Second, while in thecry the goals of formal and non-formal 
education seem to be different, in reality both are attempting to do 
many of the same things, but from different perspectives. Both are 
trying to bring a people and an economy to Increased personal and 
national productivity. Both formal and non-formal educators are 
aware that education, of the right sorts. Is an Important Instrument 
for national development. 

Third, both approaches to education often use similar if not 
the same methods and materials. Even where this Is not the case, 
minor modifications would enable the use of many Instructional 
materials interchangeably between formal and non-formal systems. 

Non-formal education Is seen to be responsive to the cry of 
the masses for relevant education. Formal education has been beset 
with this demand for a long period of time with relatively little 
response. Now that alternatives to formal education are being 
planned and provided, formal education itself Is belatedly attempting 
to become more practical. Thus the formal institutions are becoming 
somewhat less rinld and are patterning their approach closer to the 
non-formal model --suggesting points of ultimate parallel In materials 
and procedures. This can be seen most clearly In extension programs 
and in uses of radio and television to extend the schooling system. 

Fourth, though both non-formal and formal education are 
working to increase the national levi&l of education for national and 
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human resources development, they are both frustrated. Both non-formal 
and formal education realize the enormity of the task In terms of 
personnel, finances and material, Formal education Is beginning to 
recognize that It has not met the expectations of either Its con- 
stituents or its own leaders; the problems have overcome the 
promises. Non-formal education, however, has several things In Its . 
favor that formal education does not. The fact that non-formal educa- 
tion exists in more flexible settings. Is person-centered, focuses on 
practical uses of knowledge, and yet Is systematic all tend to make 
non-formal education more effective and efficient for development. So 
then, while both formal and non-formal education are facing similar 
frustrations, they do so for different reasons: formal education 
because of its lack of efficient effectiveness, and non-formal educa- 
tion because of Its Inability to do more of what It Is quite good at 
doing. - 

It is quite conceivable that non-formal education holds the 
key to learning effectiveness for both formal and non-formal modes. 
Formal education needs to continue to study the reasons for success 
of its non-formal counterpart and seek to adopt and adapt these to Its 
own programs. On the other hand, non-formal education needs to learn 
from its more established counterpart some of the lessons of educa- 
tional life, instructional design, and learning theory, to name Just 
a few areas, so that It will be able to Increase Its efficient 
effectiveness In instruction. 

It is necessary to add a cautionary note. Non-formal 
education is regarded by many as "antl-establ Ishment" edutatlon. It 
is often promoted as the antithesis of formal or Institutionalized 
education. There is much room for doubt about this general I zat lort. 
Especially since established educational agencies and Institutions are 
getting into non-formal education the scene Is changing. Whenever the 
"establishment" begins to use any devices or procedures (whether or 
not they are "non-establishment") In order to achieve "establishment" 
ends, they become "establishment" functions. The distinction between 
formal and non-formal education is thus not the same as between 
establishment and non-establishment efforts. 
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learning Effectiveness as a Pol i t leal I ssue 
Perhaps one of the key elements in the controversy is that 
school ing has failed*-not necessarily that education has failed. There 
Is a high probability that under certain influences and In certain 
hands non-formal education also will fail. The Issue Is not necessarily 
school versus education^ or schooling versus non-schooling, or anything 
of the sort. It is simpler than that: effective learning Is the 
issue. In our own domestic situation, and also on the world scene, 
we are just now coming out of an era of •'overselT' In education. 
During the emergence of nations of the ''Third World, we have seen a 
kind of blind grasping for the economic and welfare gains that are 
thought to accrue from education. The result has been that the modes 
and norms of education that have been grasped have been largely built 
upon models of education essentially foreign to these nations. Most 
of these models were created on common Western European and American 
concepts of educational design and Institutional management which 
often were irrelevant to other countries. As we emerge from the era 
of oversell, frustration has set In and there is a feverish search for 
alternat ives--simple and culturally relevant ways to provide effective 
education. 

Peter Orucker has made a useful distinction between effect ive* 
ness and efficiency . The characteristic American aspiration Is for 
efficiency , which Orucker defines as . . the art of doing things 
right!*' Effect iveness , on the other hand, is "the art of doing the 
right things.** Great Is the distinction! We need both efficiency 
an d effectiveness in education. We must assure that educational 
functions relate to societal welfare, broadly and specifically 
defined. 

As outside consultants and helpers, we must find ways to help 
without exploitation. The emphasis on non-formal education Is not an 
automatic preventative against further exploitive operations. In 
fact, given the hands and given the motives, manipulated non-formal 
education can be as exploitive as any other form of outside management 
of institutions. Those who want to help must be constrained by a 
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commitment not to repeat the impositions of technocratic achievements 
that have accompanied some "helping" activities in the past, As we 
begin to employ non-formal methods and moJes, there is a need for a 
much more clear-cut theory of educational functions within a society, 
Such theory must be drawn from sociological, anthropological, and 
psychological sources. Our tendency in the United States has been to 
draw very heavily from psychological theory and to be less careful 
about drawing from anthropological and social theories as they relate 
to education. Today's current fad of over-individual izat ion of 
Instruction (In which learners are sometimes "individualized" to the 
point of isolation) results from this tendency. A socio- 
anthropological view Is concerned about the Interaction of learners 
for their educational good. Adequate theory for the planning of 
educational functions within a society must be drawn from the whole 
range of the social sciences. 

What Is education within a society and how does it function? 
Here Is the primary question that must be answered before beginning to 
Innovate. The emphasis on non-formal education Is less a matter of 
new Information or ideas than It is a matter of nev-.' focus or emphasis. 
Non-formal education is now coming Into primary focus In Its own 
right. But if It is to be used responsibly as a total educational 
plan for national development. It must be seen In relation to the 
whole of the educational efforts that exist within a society. 

One of the problems In education as It relates to national 
development Is the tendency to state goals too generally. Usually 
when people come to a point of frustration in defining their goals, 
they adopt. Instead, goals that seem to be self-explanatory. In other 
v/ords, they will adopt a generalized statement that Is supposed to 
define Itself, and they substitute It for the very difficult worl< of 
really defining the appropriate educational goals. In many cases 
this tendency has been seen In the relating of formal education to 
national development. It Is not that formal education Is Irrelevant 
but that It Is not given a chance because Its goals are not clearly 
brought Into alignment with the fulfillment of stated national needs. 
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In our eagerness to help In national development we may tend to bring 
goals that we have developed In our own framework (In another part of 
the world) and use them as substitutes for locally defined goals. The 
real question Is what sort of education will most effectively relate 
to the next steps that can be Justifiably taken? Involvement of 
American public and private agencies In national development overseas 
must be disciplined by objectives defined within those national 
situations. It is necessary to clarify the needs to which education 
Is to be related. 

Non-formal education Is not a compromise. It Is a response 
to a "now" situation. We have before us an occasion to revise and to 
Innovate Instructional modes. There Is an exciting possibility that 
the non-formal education movement will open the eyes of the world to 
see alternatives to traditional didactic approaches to Instruction. 
Also, we have an occasion to Involve ourselves as technician-helpers 
rather than as goal -setters. 

The Hopeful Future for Non-Formal Education 
People learn. Institutions teach. Some people are more 
effective learners than others. Some institutions teach more 
effectively than others. Any person can learn certain things better 
than other things. Any institution can teach certain things better 
than other things. Learning is at Its most effective when a person 
is learning those things he learns best In the context of the 
Institution that teaches those things best. Effective learning Is 
necessarily involved with people and with Institutions, 

Inherent In our treatment of the elements of non-formal 
education jre suggestions of what non-formal education promises to 
Its practitioners and leaders. The first is that non-forma! education 
promises to be a more effective approach to relating education to 
national development. Closely related to this is a second promise? 
that non-formal approaches offer education that Is functional and 
practical, i.e., related to the life-needs of the people. It Is 
probably true that practicability enhances effectiveness and 
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effectiveness seeks to be practical, Non-formal education promises 
to start with the felt needs of the people In order to help them 
achieve their goals and by so doing helps the nation to develop, It 
does not take much Imagination to perceive the relation of practi- 
cality and effectiveness. 

Third, non-formal education seeks to maintain a benefit/cost 
consciousness of what It does In order to provide the most effective 
and purposeful consequences with the most efficiency . There Is an 
awareness of the potential contributions of Instructional technology 
and communication media and principles that will reduce the amount of 
personnel while increasing the amount of Impact, Involved In 
efficiency and effectiveness Is the Inherent commitment to seek for 
Innovative means to achieve the goals. Innovat Iveness . the mentality 
that looks for new. renewed or rejuvenated approaches to old problems 
Is the fourth promise of non-formal education. People In non-formal 
education are apparently less inhibited than those In formal education— 
not afraid to ask for a different approach, to try a new procedure or 
an unproven idea. 

Fifth, non-formal education offers a more eclectic, multi- 
disciplinary approach to the problem if development In a country. 
The tendency ta look towards one discipline for the solving of all 
problems is seen as insufficient. Instead, numerous disciplines are 
sought out in order to arrive at workable solutions. Formal education 
has, unfortunately, tended to isolate Itself from Its own basic 
discipl ines--particularly In the social sciences. The resultant 
promise of this type of approach to education is that decisions and 
programs will be developed from a holistic view of the learners, their 
own sub-cultures and the larger society. 

Sixth, non-formal education promises to produce short-term 
effects as well as long-term achievements . A developing country cannot 
wait decades to achieve progress. People throughout the country want 
to have certain improvements as soon as possible. Non-formal educa- 
tion promises such accomplishments. True, such short-term gain may 
have more political than economic value, but the tenuous condition in 
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many developing nations demands movement towards development of the 
entire population rather than merely an elitist few. 

Seventh, non-formal education assists In the decision-making 
of educational and developmental funding agencies on both a national 
and International level. This is possible through the effects which 
can be observed after a short duration. The agencies do not have to 
wait for a whole generation to grow up Into leadership before results 
can be assessed. Rather, effects can be sometimes seen In just a few 
weel<s or at most a year or two, allowing funding agencies to make 
assessment and reassessment of the consequences of a program over a 
relatively short time. Related to this Is the eighth promise, namely, 
that non-formal education provides a more rapid and Immediate measure 
of the effectiveness of Instructional desity n. The objective of the 
non-formal educational processes are usually defined In the short- 
range, thus making Intended behavioral changes, even though small, 
visible more rapidly. This, In turn, allows for prompt feedback 
regarding the relative effectiveness of the instructional design. 
Continuous analysis Is possible, leading to continuous modification 
of the procedures to meet the needs, goals and expectations of the 
participants. 

Problems Confronting Planners 
of Non'Formal Education 

Non-formal education is confronted by several problems. The 

first is the tendency In many developed as well as developing 

countries to have a blind faith In instructional technology and medla-- 

especlally the mass media. That these tools hold tremendous promise 

as part of the solution to development by education is unquestioned; 

but the tendency is to Invest national programs In the facilities 

before more basic questions of needs, goals and availability of 

Instructional resources (personnel and material) are answered. It 

seems that advisors to non-formal education development must take 

care to avoid catching this "disease" from their clients! 
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Second, there U a closely related problem of avoiding the 
<>erious and difficult ground-worl< of cultural and sub-cultural 
analysis, goal setting and resource inventory before designing a 
delivery systenii The great temptation is to adopt someone else's 
system "locl^, stocl<, and barrel," or to develop a new system without 
l<nowing, enough about the basic and determining factors in the environ- 
ment of the learners. Again, the consultant's responsibilities are 
to dsl< the hard questions that must be answered before proceeding 
into the actual development of an instructional system. 

Third, it is evident from our observations that in some 
developing countries (as in the United States) bureaucratic conflicts 
are a practical problem with which one must deal. Jealousies and 
political fighting within, between and among bureaus and ministries 
can be a problem. It would be naive for planners and consultants 
on non'formal education to thinl< that they will not be involved in 
the politics of bureaucracy. We will have to figure out how to worl< 
as much as possible within the existing bureaucracy without adding to 
it and without becoming frustrated. 

Fourth, non-formal education can be oversold to developing 
countries. The result could be the promise of meeting needs that 
simply cannot be met because of limited resources, in terms of per- 
sonn<»l, finances and material, and too little time to develop an 
instructional design that fits a particular group, sub-culture or 
nation. In other words, non-formal education might be seen as a 
panaced--but without the time necessary to develop workable procedures 
and without the required resources. Advisors to the developing 
countries will have to bear in mind that although non-formal education 
does produce short-range change, it does not produce a full-fledged 
national development program within a short period of time. It must 
be remembered that even though a pilot project can demonstrate its 
significant effectiveness, this is not a fully developed program for 
the masses. Mass education does tal<e time to be developed. It would 
be wise, therefore, to have realistic expectations regarding the 
changes that non-formal education can produce wUhin a limited time 
period. 
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It Is not surprising to find that the ministries of education 
In various developing nations are thinking seriously about alternate 
forms of education. Virtually Inseparable from the revolutionary 
motif is the redesign of institutional forms. It Is very apparent 
that leaders in education in Peru have been reading the major world 
figures in educational reform. Specifically, the Influence of Paulo 
Freire can be seen in the emphasis on consclentlzatlon within literacy 
and basic community and rural development programs; and the Influence 
of Ivan lllich can be seen even in the titles of the documents pro- 
duced by the ministries of education, as In the 1973 Peruvian publica- 
tion entitled "Quia para la Apllcaclon de Programas Pesescolar Izados 
de EBL." In some respects the attention to the essence of revolutionary 
thought In education Is less evident than attention to facade. 
Specifically, there is good reason to wonder If consclentlzatlon Is 
not merely being used as a camouflage for larger and slightly more 
effective programs of literacy, and If "de-schooling" Is not being 
reduced to merely a label covering some rather school -or I en ted sorts 
of activities--legitlmatized because they are being done outside the 
regular school buildings. Two basic problems seem to be embedded In 
the conceptual structure through which many ministries of education 
are dealing with non-formal educat lon--or what they usually call 
"adult education." First, too commonly, the ministry of education 
operates as if other agencies and ministries are not already deeply 
involved with adult education and community development. Though the 
ministry may point to a coordinating council through which policy 
and specific program clearance Is coordinated with other units of the 
government, conversations with peopH Involved in various other 
ministries leads us to seriously question whether or not the problem 
lies at so easily accessible a level. For example, the definition 
that the ministry of education uses for "adult education" may be so 
narrow as to remove from consideration the great variety of training 
projects conducted by the ministries of agriculture, health, labor. 
Industry, and rural development. Any modern concept of adult education 
may reach out in so many dire.^ ons through its "adult education" and 
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'*de-schoonng" operations that it unl<nowinc|ty duplicates and vastly 
competes with existing programs. (An equally hazardous extreme 
would be for the ministry of education to seek to bring all of these 
programs under its own control and jurisdiction.) 

Second, there is quite clearly a tight grip on the old 
schooling concept. It is easier to thinly of non-formal education or 
"de-school ing" as a change of delivery systems than it is to think of 
a fundamentally reconceptual ized education. Much of what is being 
described today as "non-formal education" will ultimately fall back 
under the rigid framework of the step-wise schooling concept. Although 
we CO not argue against the value of schooling for some purposes, 
the very limitations of step-wise concepts of education are part of 
the drain upon "'^sources of all nations. When we find, for example, 
that one of the models most widely promoted as exemplary "non-formal" 
education is that of the British "open university," we must seriously 
consider that such a view of non-formal education is certainly not 
equivalent to de-schpol ingi The open university idea suggests a 
system of examinations through which people can obtain schooling 
credits for studies gained through alternative procedures. The 
alternative procedures, once created, would feed into a system that 
still sees the formal education establishment as the standard and the 
ideal . 

We must question whether or not ministries of education are 
the most promising units of government through which to stimulate non- 
formal education. In certain nations where the development scene is 
rich with various forms of non-formal education, the ministry of 
education is far from the most influential ministry and often it lacks 
experience in inter-ministry cooperations. The continuing boundary 
of thought seems to be located just about where the ministries of 
education characteristically have seen their limits: if it isn't a 
national -scope centralized program they don't respect it. Outstanding 
rural development, community development and other successful programs 
of non-formal education are sometimes criticized out-of-hand by the 
ministry of education people: "They aren't as good as formal education 
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because they are too locaN-too much related to a unique communlty-- 
not really a program of national scope." Yet a close look reveals that 
the people from the ministry of education who mal<e these criticisms 
are essentially a group of strangers to non-formal education, Other 
than for a few untested ideas about alternative delivery systems for 
classical schooling, they don't even talk the language of non-formal 
education. 

No wonder that we find genuine fear on the part of community 
development workers— fear that the new wave of interest and promises 
of support are but the front edge of a steamroller of control and 
ul t imate ass imi lat ion. 

In certain situations there is such a high degree of political 
sensitivity that every act seems to have a political meaning, Only 
the most irrelevant, abstract of roundabout forms of education are 
encouraged by governments that fear the uprising of the peasant 
classes, Yet, clearly it is exactly these peasants who have the 
greatest needs for human resource development. 

Much non-formal education operates today without benefit of 
government support or regulation. And we believe that is as It should 
be. When government moves into non-formal education some things change. 
Especially at the village or local community level such changes are 
a threat. Consider the loss of effectiveness when the new non-formal 
education technician (agent or instructor) is perceived as a government 
agent. The program no matter how good it Is, will be less effective 
than it was under the person who was there before--who was known not 
to be a government agent. Confidence and credibility are fragile. 
Government support, among people who have no strong reasons for con-, 
fidence in that government, will run the risk of becoming an over- 
powering phenomenon. The focus on learning effectiveness Involves 
issues of political initiatives; it is likely impossible for any aspect 
of non-formal education, even the elemental aspects of effectiveness 
to be free from political implications. 

Whether we do it naively or knowledgeably , if we work in non- 
formal education we must be willing to face up to the political 
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realities and the political conditions that e;<ist at the community 
level. There are two problems; (1) the somewhat Insular thinking In 
the administration of education that tends to assume that anything 
educational is the responsibility of ''educators," and that when anyone 
else is engaged in anything called education (such as rural adult 
education for agricultural development) the ministry of education some- 
how ought to .have its hand In it. If this problem were a basic Issue 
in the United States, the County Board of Education would tai<e over 
all agriculture extension worl<. People with "Education" as their 
label tend to use classrooms a lot; they tend to do things that 
school ing* type people tend to do--not because they believe that It Is 
better but simply because they tend to thlnl< this way about organizing 
learning. Especial ly In countries where non-formal education is well 
developed in agriculture, and in the ministry of Industry, the ministry 
of commerce, and all those other sectors where, for a long time there 
has been non-formal education, a danger now exists that new juris- 
dictional battels will break out. The ministry of education Is waking 
up to the fact that you can call these operations non-formal education ; 
and so maybe they ought to be under us. 

The second problem occurs in the local community when a 
government agency (whether the ministry of education or the government 
as a whole) fears anything that it does not operate. We have observed 
many valuable educational projects that aren't financed by governments, 
and there is a danger of losing some or all of these In a massive 
total bureaucratic absorption of the whole of non-formal education In 
order to create a government-mandated and supported system of non- 
formal education. That this might happen has made us more than a 
t ittle anxious. 

Through experience in consultation with formal and non-formal 
education and through experiences with the manifest attitudes of 
governments, we have noted an unhealthy condition: anxious govern- 
ments tend to divide educational operations Into two classes--safe and 
unsafe . By "unsafe" we refer to politically unsafe or politically 
dangerous. Formal schooling is seen as "safe" because it is assumed 
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to be manageable. Within formal education, the curriculum Is 
structured and can be centrally controlled from an office In the 
ministry of education. Thus It Is assumed that formal schooling can 
be made responsive to government policy. 

By contrast, the sort of educational opportunities that 
operate outside of the government, through philanthropy, commercial 
or Industrial initiatives, self-help within communities or through 
governmental aid from other nations are suspect If they do not allow 
for being regulated as does the formal educational establishment. 
Community development, for example. Is usually concerned about health, 
welfare and human rights— more concerned about basic human needs than 
about school I ng or mal<lng people more schoolable (mal<lng people able 
to pass tests). Such educational activity Is thought to be "unsafe." 

The distinction is not realistic. In reality, any education 
delivered meaningfully to the peasantry In an underdeveloped nation 
Is potentially revolutionary. Governments are deceiving themselves 
by mal<ing the distinction between "safe" and "unsafe." They are 
wasting time and people when they militate against or persecute 
"unsafe" education. Such governments would be better off to recognize 
all of education as being potentially revolutionary and to see that 
when they advocate mass education they potentially advocate overthrow 
of totalitarianism. Therefore, any government that attempts to make 
this neat distinction while also claiming to advocate mass or common 
education, is deluding Itself. The potentiality for stimulating, 
revolutionary behavior, so widely feared by totalitarian governments 
In reference to "unsafe" education, is also present even In primary 
education or government-sponsored literacy training. Any education, 
in any meaningful form. Is apt to put Ideas Into people's heads. It 
Is apt to produce an incentive, a searching for, an urging for more 
opportunity, more grasping, reaching out for more of what that educa- 
tion might mean. Education tends to liberate, to free men and women 
to see their environment as being to some extent changeable, and to 
a great degree being in need of change! 
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The world today shows clearly two examples of common, mass 
education being recognized as revolutionary. All of education has 
been harnessed as a revolutionary force to change the social structure 
in Cuba, and even more successfully, in China. In both cases, educa- 
tion, rather than being the enemy of the government, has been enlisted 
by the government to be an important agent of change. Education 
Itself was deemed "safe" for the government's purposes and "unsafe" 
for the status quo. What makes these situations different Is that in 
both cases revolution was the intention of the government rather than 
the enemy of the government. But when governments are in the hands 
of socio-economic elite, any threat to the social structure represents 
a threat to the government. The people who have power are not 
enthusiastic about seeing themselves lose that power; therefore, they 
resist anything that is revolutionary. 

It will be interesting to watch the progress and effects of 
massive investments in "safe" education in certain revolution-prone 
countries. It seems likely that even as a result of efforts to broaden 
the base of schooling and reach more people with "safe" education 
(government controlled schooling) there will be social revolution- 
orderly or disorderly. 

In the meanwhile, and much to our anxiety and grief, some of 
the "unsafe" programs of community development education we have 
identified as good examples of non-formal education have been gently 
but firmly taken over by government agencies subsequent to our identify- 
ing them. We wonder if we are informers or agents being used against 
the very people that we thought to help by dramatizing the effective- 
ness of their work. Some of the non-formal educators we have come to 
respect have been removed and replaced by government functionaries. 
We can only wish that the false distinction between "safe" and "unsafe" 
ec^ucatlon could be eliminated and the whole of education be accepted or 
rejected in terms of its learning effectiveness In the lives of people. 
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A nagging anxiety about non-formal education, the new king J 

For Herod sought to learn of the wise men where the new 
king was«-not so that he could honor him, but so that he 
might lay hold of him to control him or to strangle him. 
In his heart Herod feared the new king and the threat to the 
Institutions of the day. 

And the wise men were warned In a dream not to return to 
Herod to tell him where they had found the new king. 

And In those days Judea was an underdeveloped nation. 



--adapted from an ancient manuscript. 
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Ted Ward 
Lois McKinney 
John DettonI 
James Emery 
Norman Anderson 



I'd have you paid by pleceworki So much for 
each child who learns one subject. Ort even better, 
a fine for each child who does not learn a subject. 

-The Schoolboys df Barbiaha. Letters 
to a Teacher/ p. 76. 

For ail of their humanistic motives and their use of emotional 
arguments, the Schoolboys of Barbiana are inclined to think in "systems 
concepts. The use of systems concepts, logic and terminology is 
rather popular in recent years. Some use the terminology in order to 
sound "in** on the space-age Jargon of science and technology^ Others 
use the logic of systems analysis to rationalize complex social prob- 
lems that defy conventional modes of thought, and others use the 
concepts of systems thinking because the world that Jolts them seems 
somehow to be mcide of good and evil forces that group themselves in 
clusters, networks, sets, and teams to alternately help and hinder, 
encourage and discourage, stimulate and frustrate. Today's citizen 
of the world--even the youth of many lands--appreciate the fact that 
real problems rarely have simple solutions. Systems concepts have a 
degree of '*fit** with the complex and troubled times. 

Try looking at a take on any map. It seems to have such 
a lot of water, but in reality It has exactly the same amount 
as the stream that fed it. The flow of water has simply 
slowed down. It loses time while taking up much more space. 
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Then at the outlet it begins to run again and we can see 
that it is the same stream it was before. 

The elementary grades are the lake. A boy who is 
regularly promoted takes up five desks. When he repeats 
he occupies six. seven, eight . . . • 

When you stop flunking pupils, you will in the same 
stroke solve the problem of crowded classrooms (Schoolboys 
of Barbiana, p. 39) • 

The rudiments of a systems view of education are all here? 

input, processing, and output. The boys use the concept in the way 

that an educational systems designer does. They think In terms of the 

ways that the processing procedures interact with the input and thus 

determine the nature of the output. And the problem of the benefit/ 

cost ratio in the system is seen as inseparable from the prociessing 

procedures. 

No less than the schoolboys of Barbjana, we are concerned that 
those who plan and provide educational experiences do so with a basic 
commitment to creatively involving those they seek to help; effective 
learning seems intimately bound up In this condition. A systems 
viewpoint is Inherently concerned about what happens to the "input." 
How many are lost? How could the fit between the needs and character- 
istics of the input and the "processing" functions be improved? How 
much of what sorts of changes are seen at the "output" stage? Are 
these valuable changes? In whose eyes? 

Your "compulsory school" loses '♦62,000 children per 
year. This being the case, the only Incompetents in the 
matter of school are you who lose so many and don't go 
back to find them. Note: we find them in the fields and 
factories and we know thfem at close range (Schoolboys of 
Barbiana, p. 29) . 

In this third quotation the human-value potentialties of the 
systems approach to design, planning, and evaluation becomes highly 
visible. Systems exist; they don't come into being because the planner 
decrees them. Even as a dam and channel embankments control the water- 
way against flooding and destroying people, so the systems designer 
thinks in terms of harnessing the functions of social and institutibnal 
systems so that they can help more than hurt. The values In the old 
system at Barbiana had crushed and destroyed; through their Involvement 
with a sensitive and creative designer, the boys came to experience a 

i 
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new 5ysteni--whereln more humane values could be realized. The con- 
cern for human rights and welfare led to a fundamentally redesigned 
system In which the boys (the learners) had a share in determining 
goals and processes. . . 

Concern for Rational Planning In 
Non-Formal Educat ion 

For political and sociological reasons there is anxiety about 
the increasing emphasis on non-formal education. If non-formal 
education should become highly visible and dramatized as a "sleeping 
giant" or "new wave of hope" the results could be unfortunate. 
Politically, there is a danger that non-formal educational operations 
might be swallowed up organizationally or forced into bureaucratic 
tnolds in order to conform to the requirements for "support" or "coordi- 
nation." Sociologically, there is a probability that when a formalized 
sector of society embraces, interlocks, or supports a non-formal 
sector It will change it, intent ional I y or unintentional ly;. such 
changes would tend toward formalizing and, potentially, away from 
integrity with aspects of the community that support the non-formal 
function. 

Thus a fear has arisen that consultative recommendations about 
non'formal education could inadvertently lead to its pollution and 
decay. Therefore, challenges are raised, over each transfusion of a 
procedure or goal from the formal sector into the non-formal. These 
challenges are of special concern in the matter of learning effective- 
ness. 

Research on human learning makes no distinction between formal 
and non-formal settings. Findings are reported as observations and 
conclusions about learning; and the applications typically refer to 
conditions of learning of the schooling sort. Thus the study of 
learning effectiveness in non-formal education must be projected, to 
some extent possible, from what has been learned in the formal sector, 
augmented by what has been learned in agricultural extension and 
communication r-e&earch. 
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A preliminary assumption reflects a guarded stance*. The 
factors tliat lead to effective learning in formal education may not 
be the same as those that lead to effective learning in non-formal 
education. A balancing assumption has also been basic to our examina* 
tlon of learning effectiveness in non-formal educationj to the extent 
that the family of man shares in common certain basic needs, and to 
the extent that the sociological factors underlying all communities 
give common meaning to the aspirations of man, effective learning 
will have essentially common cross-cultural characteristics and may 
result from essentially common factors--whether the setting Is formal 
or non-formal . 

These two assumptions le^d to a- paradox: on thie one hand, it 
is not to be argued that a given instructional procedure or material 
will lead to effective non-formal learning merely because it is Itnown 
to do so in certain formal education. But on the other hand, the 
fact that a procedure or material contributes to effective learning 
in a given situation suggests the probability that it will similarly 
contribute to effective learning in another situation— to the degree 
that the significant variables of learner needs, aspirations, and 
sociological conditions are similar. Avoiding an inappropriate 
transfer of Ideas from formal education Into non-formal education 
depends heavily on the screening of suggest Ions— less in terms of 
their source than in terms of their relevancy to the particular 
learners and the particular non-formal education setting. (Generaliza- 
tions are even less feasible ,than in the formal education sector.) 

Special attention to the characteristics of learners, the kinds 
of human and material instructional resources available, the settings 
within which the new learning will take on mean! ng is required in 
planning for effective learning in non-formal education. Whether 
this is more true or less true in reference to forma.l education is 
beside the point. 

When a wide variety of variables is important to a planner 
or designer, contemporary technology (in any field of natural or 
social science) suggests a systems approach. The major indication 
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for using a systems approach is concern for the interrelatedness of 
many and varied factors within a pattern or unified whole. Programs 
of non-formal education are always of this sort; such a program is 
expected to provide a specified set of services or resources to a 
specified group of people in order to achieve specified learning 
outcomes. Further, the social context which structures the needs and 
aspirations of the learners will interact with the learners and, In 
turn, be affected by the learners. 

It is assumed that all instructional experiences (beyond the 
most Informal of the societal Influences that contribute to human 
development) spring from some sort of plan, design, or intentlon--no 
matter how casual , partial , or sub-conscious. From this assumption 
it follows that the degree of learning effectiveness resulting from 
a given instructional experience can be considered a measure of the 
quality of the plan, design or intention. Improving learning effective- 
ness requires improvement of the instructional plan. In this sense, 
planning is no more associated with formal education than with non- 
formal education.'"' 

Why SYSTEMS Planning? 
Systems approaches to anything imply technology; and "systems 
for education," "instructional systems," and "learning systems" are 
terms strongly associated with the technology movement within formal 
education during the 1960's. If one assumes that the technology 
movement has, in fact, been influential .In reshaping formal education, 
then a question can be raised about the possibly inappropriate trans- 
fusion of the systems approach from the formal to the non-formal 
education sector. But a close look reveals that the assumption Is 
unfounded. Oettinger contends: 



"Note the distinction between instructional planning as used In 
this monograph and educational planning or national planning for ecjuca- 
tion, etc., as commonly lised by "educational pjanriers;** The emphasis 
in this chapter is on the design of effective jearnlncj experiences, 
rather than on techno-economic systems. 
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The present tools of formal systems analysis work best 
on we 1 1 -defined, simple, concrete models Involving 
quantifiable concepts, measurable data, and, above all, 
thoroughly understood theoretical structures which 
adequately reflect reality (Oettlnger, 1969, p. 65). 

This description excludes most If not all of formal education 

as It Is known today-if for no other reason than Its typical web of 

unspecified Intended outcomes. Why does formal education exist? To 

••educate," a virtually hopeless purpose to bring under systems planning. 

Why does non-formal education exist? Program by program, non-formal 

education exists in order to make it possible for people to be changed 

In certain specific ways» adding or improving given skills or 

competencies. Thus, non-formal education constitutes a much more 

appropriate framework in which to make use of a systems approach to 

planning. 

To some extent formal education In the United States has been 
resistant to educational technology. In recent years"stf)ce the 
upsurge of Instructional systems technology--! t has become popular 
to attack educational technology from a humanistic stance. Rejection 
of the concept of school as a learning factory, with all its pejorative 
and metaphorlc Implication, Is becoming a respectable stance: (one 
might suspect that It Is, for some, a cheap stance, similar to being 
against sin and In favor of the welfare of mankind). Rejecting even 
the words teaching machines , instructional systems , computer- assisted 
Instruction, delivery systems, and the like, is increasingly. popular-- 
in the name of humanity and concern for the affective aspects of 
learning. Underneath there Is a profound Issue: comprehensive 
education, as It has developed In the western woi ! < and as It Is 
epitomized by the American Ideal of the school for ail the people 
has too willingly accepted the whole burden of the socialization 
process. (Whether or not It fulfills Its innocent promises Is of no 
concern In the Idealized Imagery.) In contrast to the amorphous 
educational-total tty view of schooling Is any view of learning that 
defines precise outcomes. For example, a view of schooling as a 
total process of development of the competent citizen Is at odds with 
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educational evciludtion chat dsi>es$es and compares arithmetic test 
scores from school to school and from state to state. On one side 
of the controversy are those who contend that the gestalt of educa- 
tional development is larger than any of the bits of measurable gain 
and that a preoccupation with the bits can obscure the bigger issues; 
on the other side are those who maintain that the issues, crucial or 
trivial, are real only If they are manageable— and that management 
begins with definition and specification. 

The twin foundation-stones of the educational technologist 
are "precisely" defined objectives and "precisely" measured learning 
outcomes. After nearly fifteen years of technological nudges at the 
established formal education structure. It Is becoming more clear why 
the teaching machines sit on the closet shelf. It Is now reasonable to 
reflect that educational technology Isn't warmly accepted by the formal 
education structure--much less can It be considered a legitimate child 
of western traditions of formal education. Oettlnger concludes: 

The formal educational system i-s'v!"ound to society In a way 
that is almost ideally designed to thwart change. Little 

substantive change is therefore to be expected In the next 
decade (Oettinger, p. 215). 

Herein lies an amusing irony: the arguments for measurable 
outcomes are now the province of "modernlzer ." Such strong, emphasis 
on the content of learning (Inherent In the technological approach) 
was formerly the hallmark of the traditionalist! 

The increased focus on non-formal education has revealed a 
high degree of content emphasis. The old-fashioned school is not 
unique as a vestige of content-emphasis; non-formal education Is ful 1 
of emphasis on content. In non-formal education learners typically 
know why they are there, what they expect the experience to do for 
them, and what they intend to do with the learning. Further, In non- 
formal educat ion--especlal ly where people are free to walk out of an 
unsatisfactory exper lence--there Is an Internalization of the criteria 

effect iveness of learning that can and will be, acted on. The 
internal i2!at ion becomes expectation; expectation builds toward 
motivation and motivation becomes a basis for evaluation within the 
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learner . In non-formal education the learner usually has ways and means 
of acting upon his evaluations of the experience. Formal education 
has little of this pressure upon it; thus content focus and technologies 
based on the "defined objectives" concept are less apt to tal^e hold in 
formal education than in non-formal education.'' 

Perhaps the specificity and clarity of purposes and learning 
objectives in non-formal education maizes it more 1 lively that tech- 
nology will relate appropriately and be accepted as a partner in the 
educational process. Thus systems planning of instruction may become 
a basic procedure in non-formal education. 

Basic Assumptions about Non-Formal Education 
"Non-formal" relates more to the motives of education than to 
the modes of education. From place to place "non-formal" education 
uses virtually the whole range of Instructional procedures used In 
formal education. To a lesser degree, "non-formal" relates to who Is 
spoVisoring the education. When education Is carried out by the organi- 
zations or agencies that are al ready establ I shed or recognized as 
"educational" (for example, the Ministry of Education or a university), 
it is usually assumed that the education is "formal." When the educa- 
tion is carried out by organizations or agencies that are not 
primarily committed to the operation of educational Institutions, 
the efforts are said to be "non-formal" education. 

But a distinction based on these factors is most unfortunate. 
Procedures used In non-formal education are no less apt to be 
pedantic, restrictive and rigid merely because they are sponsored by 
an agency not ordinarily identified In education. Further, It does 
no justice to the important procedural Innovations being used by 
educational establishments to label them as being "formal" with no 
regard for their non-formal Instructional modes. Some of the most' 

■It 

Conflicts arising from concepts of evaluation as a concern 
for specific learning Increments versus a concern for broad generaliza- 
tions about human development and social competence are also apparent 
in the arguments for and against the National Assessment of Educational 
Progress in the United States. 
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Important Innovations in education during this century have come 
through the experimentation that formal Institutions have done In 
developing truly non-formal modes of education, The significant 
expansion of cooperative extension services (as In rural and community- 
life education in the U,S,), adult education in many parts of the 
world, "radio classes" (as In Australia, Colombia, India, and Italy) 
and other expansions of the efforts of ministries of education to 
broaden public education through mass media of communication are 
contributions of the "formal education" sector to the development of 
non-formal modes. Thus the arbitrary distinction between formal and 
non-formal education is unfortunate when It results In a diversion of 
attention from the central issue of effective learning. 

Perhaps today the sides are drawn, as If to battle, because 
of the charges of ineffectiveness and Inefficiency against the 
establishments of formal education, Such unfortunate polarization of 
"good guys" and "bad guys," after the style of Inferior movies, tends 
to obscure the more vital Issues. The most Important need today Is 
for effective learnlng--reagrdless of the sponsorship of the educa- 
tional operation and regardless of the label "formal" or "non-formal" 
that may be attached to It, 

Probably there Is little Inherent difference between effective 
learning in non-formal situations and effective learning In formal 
situations. In contrast with both formal and non-formal learning, 
informal learning is most apt to be different, since Informal learning 
Is likely to be "unconscious" In the sense of Incidental and non- 
Intentional (so far as the learner is concerned). For example, the 
learning of one's mother tongue Is mostly gained through Informal 
learning situations. For the infant In the family and a child In the 
neighborhood. Informal learning begins long before the day that formal 
or non-formal education begins. 

Occasionally we need to be reminded that schools do not make 
people learn. Schools may help people learn; certainly schools can 
provide opportunities to learn; and schools can even help people 
become more interested In learning. But schools In general are but 
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one way to bring people into contact with educational resources, 
Whether or not the poeple learn and what may be the value of what 
they learn are issues sometimes overlooked. It Is not enough to 
build schools. It Is not enough to provide teachers. Assuring 
effective learning demands that ends and means (goals and procedures) 
must be aligned with significant values of the society (See Figure 1), 

Effective learning depends on? (1) relevancy of the educa- 
tional goals to social values, (2) accommodation of the learning 
characteristics of learners, and (3) accommodation of the pedagogical 
expectations of the learners. Thus those who are concerned about 
effective learning (whether the educational setting is formal or non- 
formal) must evaluate the relevancy of the educational experiences to 
social values. They must also be careful to select materials, pro- 
cedures and methods that are appropriate to the characteristics, goats 
and expectations of the learners. 

Whether or not the current wave of Interest In non-formal 
education is a fad is a legitimate question. Education In the 
twentieth century has manifested the volatility and Instability, as 
have most other si?cial Institutions. The advent of the communications 
revolution has aggravated the already unstable situation: the pendulum 
swinging from one extreme of philosophy and methodology to another Is 
now accelerated, but shows no new signs of coming to a definite rest 
position. Thus the newly dramatized term "non-formal" may add little 
clarity to an already < onf used situation. If we are engaged In one 
more semantic exercise or one more attempt to find utopla by putting 
new labels on the status quo, then the excitement about non-formal 
education is Indeed a fad. 

Al ternat Ives ! 

Our experiences with those who are seriously concerned about 
non-formal education leads us to the conclusion that the phenomenon Is 
neither trite nor futile. But the term "non-formal education" leaves 
out the key word alternatives . Those who are seriously Interested In 
non-formal education usually express their concerns In terms of needs 



75 



8KT coinf mum 




;the: iNDiviixa.UARN's 



SimJMS 6 SaCIETYS 



m IMDIVIOAL LB>Ji.W5 
' THESOaETY PRCVIDlSMAMV 

5a-(aX ISOKJE. CF 

EFFE.CTWE mo EFF\aE.NJT. 
Smi C*5!HEJ!. OF" 




m\ "WL llBERATED* Wit OFnWD 



==1 




Figure 1. --Defining Learning and Schooling. 
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for alternatives to otherwise over-ly-costly or unresponsive and 
anachronistic formal vystems of education. Thus the Issue Is rarely 
the degree of formalnc^ss of the educational operation, but Its costs 
and Its performance in terms of reaching objectives,' 

"Non-formal education" Is a rather non-descriptive collective 
term thrown over anything and everything in which people who seek 
educational alternatives might be Interested. Thus the technologies 
of formal education may be employed In non-formal educatlon-^to the 
extent that they can be used to reach different objectives and reach 
them at lower costs. 

Many people most clearly Identified with the search for non- 
formal alternatives in education are "angry" people. Some are 
frustrated over the tendency of formal education to enrich and per- , 
petuate elitism and meritocracy within their societies. It is charged 
that such educational systems do little or nothing to solve the problems 
of massive ignorance, poverty and Isolation from the determination of 
governing authority and human destiny In general. Others have more 
specific criticisms of weaknesses of the "establishment" that they 
would attempt to relieve through alternative ways and means In educa- 
tion. Thus, the reformers who object to the alleged depersonalization 
and irrelevancy of American education find themselves in company 
with the educational revolutionaries of South America, Africa, and 
Asia whose major concerns are substantially different. The kinship 
of reformers and revolutionaries derives primarily from the fact that 
they are all seeking alternat ives"for somewhat different reasons, 
toward somewhat different objectives, and usintj essentially different 
means. 

Malcontented persons from many different countri©:?, represent- 
ing various degrees of urbanization and modernization. Identify with 
one another In terms of their quests for alternatives to the con- 
temporary western-style Institutionalized education. This fact con- 
stitutes one of the stronger replies to the charge of faddlsm. "Non- 
formal education" may be a faddish label , but the earnest quest for 
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lower cost alternatives to substitute for classical educational pro- 
cedures and resources is substantial. 

In summary, the need for effective non«formal education is 
usually expressed as a need to find alternatives: the alternatives 
are needed because of one or more of the following motives: 

1. To bring education to people who are not being 
reached by the formal educational establishment, 

2. To providii education at lower cost, or 

3. To direct educational efforts toward goals that are more 
practical ot 'ore closely related to the learners' 
heeds within heir society. 



Increased Learning Effectiveness Through 
Systems Development , 

The frontiers of research in human learning are concerned less 
with the science of the brfjn than with the understanding of learners 
and environments for learning. The mysteries of mental processes 
remain stubborn, but improving the technology of instruction does not 
depend on understanding how the brain works. Further, as typically 
used In reference to non-formal education, "effectiveness of learning" 
relates primarily to pragmatic issues. Important steps forward have 
been made possible by combining the procedures of system analysis 
with refined insights into learner? and environments of learning. 

In most simple form, a systems model of an educational opera- 
tion accounts for three elements or factors: input, processing and 
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Figure 2. -^'Rudimentary Systems Model* 
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Input is what goes Into the system to be processed. Processing 
Is the series of experiences through which the Input Is modified. 
9"tput is what comes out of the system} In essence, output Is changed 
input, reflecting the changes that the processing has brought about. 

From a learning viewpoing, inj^^ut Is people (learners) and 
output is people. Output Is learners who are changed, having learned 
whatever learning is that the processing functions produce. 

With these three simple elements we can begin to use the 
syitems concept. We can visualize, and thus conceptualize more 
specifically the following important questions: 

1. What is the intended difference between the output 
and the input ? 

2. Is it reasonable to expect the particular processes 
to produce the sp^-cifted outputs? 

3. Is It reasonable. to expect these processes to function 
well, considering the realities of this particular 
input? 

^. What parts of the processing are superfluous, wasteful 
or counter-productive? 

5. In what way does the Input help to shape the processing? 
Are input values being adequately ut 1 1 Ized and taken 
Into cons iderat ion? 



"Some systems analysts think of Input as Including the 
resources that are utilized as elements In the processing operations. 
A rudimentary model for such a viewpoint would be as follows: 





In this model . the 



outcomes ;jre made 
objection to thifi 



ie inputs to the processing system ^nd the non-learning 
explicit and are given designation '*ll.^» We have no 
^but feel that the simpler model Is adequate 
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Figure 3. --The Focus of Five Key Questions. 



Typically, the Instructional designer who wishies to use a 
systems approach begins by studying a variety of approaches to con- 
ceptualization and diagramming as revealed In a wide variety of 
sources." The next step, of course, Is to conceptualize and create 
visualizations of the learning tasks and delivery systems that are 
being planned, beginning with rudimentary or elemental models and then 
progressing up through more complex views of the many components. 



"The sources are many. As a starting point for systems con- 
cepts, we suggest Systematic Thinking about Education by Alice H. 
Hayden and Gerald M. Torl<elson (Fastbacl< lf\7) t 1973i Phi Delta Kappa, 
Eighth and Union Box 789, Bloomington, Indiana ^7^01 (50c» less In 
quantity). For more advanced study, and examples of diagramming of 
systems concepts in educational design. Instructional Systems (The 
Educational Technology Review Series), Educational Technology Publica- 
tion, 1^0 Sylvan Avenue, Engl ewood Cliffs, N.J. 07632. We Identify 
these two sources as dealing with formal education In such a way as 
to provide for easy transfer of their Ideas Into non-formal education. 
For an actual application of systems design to cross-cultural and noj>^ 
formal educational problems, the following Is valuable*. Educational 
Technology'-fhe Design and Implementation of Learning Systems, 
Organization for Economic Co-operation and Development, 2 rue Andre- 
Pascal, Paris XVie I97I. More extension studies are pbsslble through 
S.G. Tickton's anthology, To Improve learningi An Evaluation of 
Instructional Technology, Vols. I 6 1 1 , New York! R. R. Bowker, 1970. 
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sub-systems and environmental conditions that impinge upon the pro- 
posed learning system. Figure A suggests the sort of rudlmer.':ary 
starting point that might be used In conceptualizing the various 
linear reUitlonshlps that would be conceptualized by a western-style 
designer of an instructional system. 

A more complex view of the whole setting within which the 
learning takes place--and, by the way, a more non-western sort of 
conceptualization of a learning system is suggested by Figure 5. 

The typical instructional design task in non-formal education 
can be seen as a series of ten problems. In the pages following, this 
set of problems is described and treated as a series. of discussions, 
hopefully alerting the designer of non-formal education to the array 
of Issues and concerns that a systems view of the tasl< can highlight. 
The ten problems are not strictly required In real life. The 
designer will need to assume that many of the suggested operations 
will be conducted simultaneously and that the Interaction and re- 
cycling among several of the activities represented on the block 
design are both inevitable and desirable. An Initial visualization 
of the discussion is provided in Figure 6. 

Problem 1; Specify the Learning 
to be Achieved 

Non-formal education is typically concerned with learning 
that has a high degree cf "practical" usefulness. Thus the specifica- 
tions of learning, as indicated in a systems development procedure, 
would be especially concerned with the learning in exactly the form 
It will be most likely applied. For example, assume that the 
practical problem for which the non-formal education is being designed 
Is the need for operators of tractors for community farms. The 
training program should specify learnings as operational skills of 
tractor operation and tractor maintenance. The learning would be 
specified in terms of its practical use, not in terms of abstract or 
theoretical understandings. In another Illustration, the learning 
objectives for a family planning program would not be specified as 
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Figure 5. "-Conceptual Model of a Learning System 
(Randall, n.d.)* 
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understandings or as "knowing about birth control techniques," but as 
the composite of understandings and behavior changes that represent 
the actual adoption and practice of family planning procedures, 

The emphasis on practical and behavioral learning achievements 
Is not only a concern of non-formal education. Formal education, In 
some countries, has undergone a similar shift In emphasis toward 
behavioral objectives In the past few years, But still, It Is In non- 
formal education that the Investments in education or training are 
expected to achieve very specific goals based on very pragmatic sorts 
of values. 

Problem 11; Describe the Target 
Populat io n 

The target populations for programs of non-formal education 
are usually rather specific and delimited. It Is within formal 
education that the educat ion-for-everyone approach has been most often 
applied. Indeed one of the continuing dilemmas of formal education Is 
the need to provide educational experiences for a diverse population. 
If target populations are not carefully defined, the educational 
experiences that are designed may prove to be appropriate for only 
some small segment of the target population. A current criticism of 
American education is that in its effort to provide one set of 
experiences for a widely varied target population it fails to provide 
appropriate experiences for those whose pre-school environmental 
background has been atypical. 

One of the most important requirements for effective learning 
Is a matching or interlocking of the planned experiences and the 
learners. Each proposed target population must be carefully studied 
and understood in terms of three major factors that vitally relate 
to effective learning: (1) the motivations, value systems and reward 
systems within whl^ih learners live and work, (2) their cognitive 
style and capabi 1 if. les in terms of previously acquired skills, and 
(3) tfieir expectations about learning and about the pedagogical 
environment. / 
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It Is the position held In this p*aper that precise description 
of the target population Is absolutely essential for successful 
application of the systems development procedure for Instruct lohat 
planning. Since we feel that this problem Is sometimes overlooked or 
minimized by those who plan non-formal education, a detailed plan for 
specifying a target population Is presented later In the paper. 

Problem 1 1 1 ! Specify the 
Instructional Tasks 

Jerome Bruner (1967) was among the first of the psychologists 
of learning to warn that teaching and learning are not two sides of 
the same coin. Identification and description of learning objectives 
Is only one step; after the Intended learning la specified It remains 
as a separate task to propose the sort of instructional experiences 
that would achieve the learning. Regardless of the apparent 
"scientific" or ted ological approach to Instructional systems 
design suggested by the "block diagrams" and "flow charts," Instruc- 
tional design is a creative task. With data about the target popula- 
tion in one hand and the learning objectives in the other hand, a 
creative designer or team of designers is ready to sit down to think 
through the many different ways that learning experiences could be 
provided. The success of this step depends heavily on the degree to 
which the instructional designers observe the data on the target 
populations and the specified objectives. But there are also two 
other- highly important factors: (1) awareness of the full range of 
possible instructional alternatives and (2) insights into the 
relevancy of the instructional alternatives to the cultural Influences 
on the personalities of the target populations. 

Specifying instructional alternatives consists of (1) identi- 
fying and/or creating (at least describing) tha possible instructional 
procedures that promise to achieve the learnincj objectives, and (2) 
making choices among the alternatives in order to move ahead In the 
development of the instructional system. (It is important to recycle 
an instructional system in order to revise the instructional 
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pfoceclures--sometlmes even to make other selections from among the 
al ternat lves--ln order to Improve the system on the basis of the 
data from the ear ly evaluat Ions. ) 

Problem IV; Specify the Support 
and Management Tasks . 

As soon as the first decisions about Instructional tasks are 

made, the support tasks can be defined. For example, if It is 

determined that the Instructional tasks are to be performed through 

the medium of television, the support tasks can be def lned--even 

before the Instrui ional materials ("software") are developed. The 

upport tasks for an Instructional system ordinarily Involve the 

system "hardware" and Its maintenance. Non-formal education typically 

goes one of two directions: (I) uses existing resources ("hardware") 

and puts the new instruction through these channels with minor 

nwdif ications; or (2) develops new resources to use as Instructional 

channels. Generally the first option is elected when the system is 

to be very widely disseminated; the second option Is used if the 

system is to be more precisely focused on smaller (but perhaps widely- 

scattered) target populations. For the first alternative, then, the 

specification of support tasks involves negotiations and joint 

planning with other agencies whose resources the instructional system 

will share, such as radio or television. For the second alternative, 

the efforts are apt to be more heavily invested In preparing .the 

support system personnel, often necessarily recruited and organized 

as an altogether new team. In any case, the design of an effective 

management procedure must begin at this point. 

Prob lem V; Specify the Level of 
PjZl^.r'^^ hc e to be L ea r n ed 

The effectiveness of systems development rests less on Its 
"scientific" nature than on its careful organization of the sequences 
and scope of decisions which must be made. In designing an instruc- 
tional system for effective learning, it is usually advisable to make 
a separate step for the specifying of the level of performance to be 
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learned. There is a difference between the learning tasl< itself and 
the level of performance. The level of performance is concerned with 
accuracy, rate of performance, or quality level of the skill. For 
example, In the tractor-operation example used earlier, after It is 
determined what the learning tasl< Is and how It will be taught, the 
question remains, what level of competency will the system attempt to 
achieve? Since a systems approach to instruct ion usual ly anticipates 
"mastery learning" rather than a distribution of accomplishments on a 
"normal curve," the Important Issue to be determined in this step is 
what will constitute the lowest acceptable level of performance for 
any learner. For example, the system might specify a 100^, frequency 
for learning to "check the oil level before starting the engine," but 
be satlsf'ied with 60% frequency of performance of the learning "shut 
off the fuel line before leaving the tractor at the end of the day." 
In matters of quality, the straightness of plowed rows might be judged 
to be very important or not very important. Since the next step 
(preparing instructional materials) must take account of these judg- 
ments about importance, frequency and quality, the specification of 
the levels of performance to be learned should be made before the 
actual design of the instructional materials. Especially in learning 
experiences built on the "mastery" model, it must not be assumed that 
al I learners are to learn every skill to a perfect level of performance 
jOO^ of the time. The "mastery" model instead very deliberately 
defines mastery, establishing a set of standards that represent the 
acceptable level of achievement of the skills or understandings. Then 
a set of procedures is designed whereby all appropriate learners will 
attain these levels. 

. . \ 

Problem Vl; Prepare Instructional " 
Ma t e r i a I s 

The preparation of instructional materials Is a set of tasks 
guided by the decisions made earlier In the specification of Instruc- 
/tional objectives and in the specification of level of performance to 
be learned. Nevertheless, there must be a high degree of Imagination 
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and creativity applied to this problem. As indicated In the section 
on problem III, designing ins^tructlon Is a creative task In which a 
designer or a design team sets up a variety of possibilities and 
selects those that seem most promising. 

Revising or adapting instructional materials that were 
designed for one purpose In order to make them useful for another 
purpose Is difficult at best, hazardous at worst. 

Fortunately, it is common in programs of non-formal education 
to develop special new instructional materials. It Is often very hard 
to adapt instructional materials that were designed for use In formal 
education. (The difficulties include linguistic demands, conceptual 
level, degree of abstraction, and basic differences In learning 
objectives.) Thus it may be more satisfactory to develop new materials 
than to attempt to adopt or revise existing instructional materials* 

Now that non-formal education has become a matter of worldwide 
interest, there is an additional hazard: inappropriate use of 
instructional materials that have originated in another culture 
(Howieson et cji . , 1968) • Particularly from the research on programmed 
instruction has come evidence that instructional specialized print 
media (particularly those that use the various forms of programmed 
instruction), and the visualized media (motion pictures and television), 
there must be an attunement between the instructional materials and 
two sets of factors within the culture: the cognitive style and the 
pedagogical expectations of the learners. Instructional procedures 
in general, and espec ial 1 y the materials for given procedures must 
be designed in such a way as to relate to the cognitive characteristics 
of learners: even within one culture, differences In learning style 
should be accommodated to increase the effectiveness of the learning; 
but across cultures, where differences of cognitive characteristics 
may be large, it is especially important that appropriate transforma- 
tion of instructional materials be made. Until recently it has been 
common for educators to make general ii^at Ions and to overlook 
cognitive differences. But It is becoming' more widely understood 
that learning style is important and that even within limited 
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geographic areas and among people of stniMar ethnological backgrounds 
differences In cognitive characteristics can be very significant, For 
example, Hovey (1971) points out evidences of a wid^ range of cognitive 
styles within twelve societies of East Africa. These differences In 
cognitive style suggest that very different procedures would be 
necessary In order to provide effective learning. 

Problem VI I ! Tra in 
Human Resources 

The people who will operate (manage or deliver) the major 

Instructional experiences as well as the people who will operate the 

support systems must be trained. Although they need not be trained 

together, it Is necessary for the training programs to be articulated 

or even overlapped in order to assure that the various human roles 

will be compatible and supportive. In a thorough system design, the 

training programs for delivery system personnel and for the support 

system personnel are planned as thoroughly and precisely as Is the 

ma In del Ivery system. Thus v/hat Is recommended here is a system--ln 

which the personnel are analyzed as target populations, the needed 

ski I Is are specif led and the Instructional tasks and materials for 

personnel training are specially designed. The value of field-trained 

manpower--especial 1y para-profess lonal or technlclal level workers 

rather than college-trained teachers Is dramatized by the successor 

of the INNOTECH "programmed teaching" projects In Southeast Aslfn 

(Fllson, 1373). 

P ro b I em V I I I i De s i gn E va I ua 1 1 ve 
Procedures 

Inasmuch as the success or failure of an Instructional, system 
usually depends on Its ability to gather evaluative data and to 
re-cycle its design and operation (make changes for Improvement) , the 
plans for evaluation must be completed before operating the system. 
The deslg.i for evaluation of the effectiveness of the system most be 
very thorough. In a systems approach to "mastery" learning, the 
evaluation procedures are based on assessing the strengths and 
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weaknesses of the system In terms of reaching Its specified objectives, 
Evaluation In formal education Is more often concerned with the 
accomplishments of the students ; whether a student "passes" or "falls" 
Is thought to be a consequence of his having "applied himself" and 
having "worked hard," In terms of the "mastery learning" approach, It 
Is the Instructional system (Including the Input screening processes) 
that Is under test, Thus» the evaluative procedures must Include data 
collection (testing) at the beginning and at several points during the 
learner's progress through the stages of the Instructional procedures} 
It Is Important to be able to Identify the exact breakdown points or 
weaknesses In the system for learners of given characteristics. 

Problem IX? Operate the System 

This problem Is self-explanatory, except for the fact that In 
a systems approach to Instruction the operation of a system, especially 
at the first. Is a sort of trial or experiment. Jn the early months of 
the operation of a given delivery system of non-formal education, the 
major objective of the operation Is to gather evaluative data. Thus 
many well-designed Instructional systems begin their operational phase 
on a small scale, even operating under the constraints of field 
trials In given test-sites where the characteristics of the environment 
and the learners are well known. It Is Important that these test* 
sites be carefully selected for their equivalence to the broadei* popula- 
tions for whom the system has been designed. 

Problem X8 Evaluate the Learning 

The primary purpose of evaluating Is to get Information that 
can be used to recycle the system. Recycling refers to making changes 
(adjustments, alterations, corrections) In the Instructional system 
In prder to Increase the effectiveness of the learning resulting from 
the system. In a "mastery" approach, evaluation also Is used to 
recycle the learner until his learned performance Is able to meet the 
level of performance specified as mastery of the learning. Especially 
In well-planned non-formal education, testing Is highly, behavioral and 
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task oriented, in keeping witli the teaming specified by tlie system. 
For example, in the tractor-operation illustration, the testing program 
is likely not to use written examination, but would rely heavily on 
evaluative observations of performance. The best of such tests use 
unobtrusive measures to gather data rather than making the learner 
conscious of being evaluated. 

Basic Questions for Planning 
In simplest terms learning can occur when a learner (L) comes 
into educative experiences (EXg^j)! 

Ex^j > i a Learning L — > Ex^^ « Learning 

But learning is almost always a complex transaction. No simple model 
of learning is adequate for purposes of instructional design. The 
planned educational experiences are but one part of a more complex 
universe of experiences in which the learner himself is a contributing 
part. Further, the learning results from the transaction of the 
deliberate educative experiences (Ex^^^) the universe of environmental 
influences l!:in^^ and the learner as a unique personality Lp|. 




Lp| « Learning 



Identifying all of the significant variables within the model 
of learning is obviously impossible. Thus it is necessary to decide 
which factors are the most Important and to plan well for their 
development. 

What questions about the target population do Instructional 
designers need to answer In order to plan non-formal educational 
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ventures that are alternative , less costly and effective? Following 
is a suggested procedure for identifying the ethno-pedagoglcal Issues 
most basic to the problems of designing for effective learningt 

Designing effective non-formal education involves consideration 
of motivations, expectations, and abilities of learners and the rewards 
and reward systems In which the learners and the learning experiences 
operate. 



What brings a 
person to the 
teaming 
experience? 



What will he 
get from the 
experience? 



What does he 
hope or bel ieve 
the experience 
will be? 

What is he able 
to do and what 
is he capable 
of learning to 
do? (i.e. t what 
are the con- 
straints of 
learning?) 



motivations 



rewards 



expectations 
(pedagogical , 
topical, 
values) 

abil Ities 



Sociological 

conformity 
societal norms 
enforcement 
requirement 



prestige 
recognition 
status 
i ncome 
power 

teacher: roles 

content 

utility 



role acceptance 



Psychological 

curiosity 
anxiety 
ambition 
anticipation of 
rewards 

self-fulfillment 
gratification 



abstract/concrete 



mental abil ity 
cognitive style 
affective 
involvement 



The first set of questions below concern motivations of learners. 

1. a. What motivations will exist? 

b. Which of the extant motivations are appropriate to (consistent, 
in harmony with) the educational goals? 

c. l^ow can these be enhanced, emphasized, dramatized? 
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2* a. What are other motivations that would be consistent with 
the educationa) goa)s7 

b. Which of these are worth inducing (creating, establishing)? 

G« How can they be induced? 

;3* a* Which of the extant motivations are inconsistent with the 
educational goals? (revealed by negative data from lb) 

b. Which of these would it bo worthwhile to suppress or 
eliminate? 

c How can they be eliminated? 



the second series of questions concerns rewards . 

k, a« What rewards (reward systems) exist in the personal -social - 
occupational environment of the learners? 

b. Which of the extant rewards are eppropriate to (consistent, 
In harmony with) the educational goals? 

c. How can these be enhanced (emphasized, dramatized)? 

5< a. What are other rewards that would be consistent with the 
educational goats? 

b. Which of these are worth inducing (creating, establishing)? 

c. How can they be induced? 

6. a. Which of the extant rewards are inconsistent with the 
educational goats? (See negative data from kb,) 

b. Which of these would it be worthwhile to suppress or eliminate? 

c. How can these be eliminated? 



The third series of questions is parallel, but concerns expectations . 

7. a. What expectations about the learning will exist? 

b. Which of the extant expectations are appropriate to (consistent, 
in harmony with) the educational goals? 

c. How can these be enhanced (emphasized, dramatized)? 

8. a. What are other expectations that would be consistent with 

the educational goals? 

b. Which of these are worth inducing (creating, establishing)? 

c. How can they be induced? 
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9* a. Which of the extant expectations are inconsistent with the 
educational goals? (See negative data from 7b.) 

b. Which of these would it be worthwhile to suppress or 
eliminate? 

c« How can these be eliminated? 

With reference to the matter of cognitive styles, mental and 
physical abil ities of the target population, the following questions 
should be investigated. 

10. What is the level of ability to comprehend abstractions (of both 
the verbal and symbolic sort)? 

11. What is the reading sl«ill (comprehension)? 

12. What are the mechanical and manipulative sl<i lis previously 
developed in th^ learners? 

13* What are the factors of health, attention span, alertness, 
concentration and application of effort that will affect the 
learners? 

U. What are the learning styles (in terms of cognitive styles and 
habits of response to pedagogy) that must be accommodated by 
the instructional design? 

Summary 

The questions specified above are primarily concerned with 
understanding and describing the target population. Appropriate 
accommodation of these factors can result, in significant increases 
of learning effectiveness in non-formal modes of education. 

The next section of the paper draws from research in several 
behavioral science traditions. The examples cited are but a few of 
the many pieces of empirical findings that have meaning for the 
planning of effective learning in non-formal modes. 

Research in the Psychological Traditions 

Rates and Patterns of Physiological 
Development 

Formal education, with its customary emphasis on the trans- 
mission of l<nowledge, has sometimes stressed the intellectual growth 
of human beings at the expense of physical and affective development. 
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The concerns of non-formal education allow no such dichotomy. The 
physiological development of learners is important in the goals of 
non-formal education, such as the teaching of sl<ills and disseminating 
of health information. Research on early physiological development 
suggests that differences in early child-rearing practices may con- 
tribute to differences in physical stature, motor dexterity, and 
general health and well-being. Hopi, Navaho, and Rio Grande Indian 
children learn to w^U more slowly than Anglos (Dennis, 19^0). 
Negro infants raised in permissive, accepting environments show 
greater gross motor acceleration than those in rigid, rejecting 
environments (Williams and Scott, 1953)* The motor development of 
Gandan infants, who are quite precocious at birth, slows down 
abruptly when they are weaned and sent away to a grandmother (Gerber, 
1958). Even though data such as the above are scanty and based 
largely upon the earl i est developmental stages, they suggest that 
planners of nbn-formal education should assess the extant motor 
sicills of the target populations for clues as to how readily certain 
tasks may be learned. They also suggest that some factors which 
contribute to adult health and motor dexterity may be altered through 
change of child-rearing practices. The above implies emphases on 
health education (especially for expectant mothers and mothers of 
young children) as well as family planning and education in nutrition. 

Emergency Reactions 

Closely related to research on physiological development are 
studies of emergency reactions, such as aggression. Early anthro- 
pologists have provided some interesting examples of cultural pattern- 
ing of emotional behavior. For example, when Santa Mata (Colombian) 
Indians have o severe grievance, they stril<e a tree or rocl< with a 
sticl<, using insulting language, until the sticl< is broi<en. The 
person who breal<s the sticl< is considered the victor (Sumner, Keller, 
and Oavis, 1927)* Similarly, Kwal<iutl Indians have institutionalized 
a potlatch ceremony. A person destroys his own property to gain an 
advantage over another (Boas, 1925). These rather extreme examples 
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from primitive societies suggest a general izable principle for non* 
formal educators: analyzing sl^ilis to be tauglit and tlie abilities of 
the learners is not enougli; institutionalized ruies governing emotional 
expression witliin a culture must aiso be understood and respected if 
teaching is to succeed. An agricuiturai education program couid faii 
because the teacher lost his temper in a society where this behavior 
is not tolerated, or, conceivably, because he created suspicion by 
"playing it cool" in a society where agression is freely expressed. 
Accommodation of teaching methods and materials must Include an 
attunement of the teaching style to the demands and norms of the 
society. If the feeling tone or modes of expression are foreign, the 
teaching may be rejected or misunderstood. Such considerations relate 
to the effectiveness of education through television as well as direct 
personal teaching. 

Primary Perception 

While physiological and emotional development cannot be Ignored 
in non-formal education, perceptual factors In learning effectiveness 
loom even larger in their importance. Systematic differences In 
responses to sensory stimuli have been observed across cultures. In 
one study (Allport and Pettlgrew, 1957) a trapezoidal window 
Illusion was used with Zulu subjects. In this illusion the window 
wavers backward and forward. Zulus, who were not familiar with 
Western windows, did not see the Illusion. Studies such as this one 
suggest that great care needs to be exercised In the use of visual 
and symbol Ic materials In cross-cult^iral teaching. Representing 
three-dimensional objects on two-dimensional surfaces requires students 
to use perceptual skills which are related to reading ability. Three 
dimensional models of actual objects will probably be the preferred 
media with llllidrate students. Thus the mechanical operation of a 
tractor will probably be more readily taught through using the 
machinery Itself than through the use of charts and diagrams. When 
direct experiences are not possible, prerequisite perceptual skills 
will probably need to be taught before two-dimensional representations 
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can be Interpreted. Specifying crucial prerequisite perceptual sl<IIls 
Is an Important step toward learning effectiveness In non-formal 
education* 

Ptagetlan Studies; Conservation 

Studies based on Plaget's developmental theory are highly 
suggestive for non-formal educators interested in learning effective- 
ness. Two distinct clusters of cross-cultural studies have evolved: 
one around his theory of conservation, and another around animism and 
related tendencies. Piaget postulated progression in the achievement 
of conservation when one attribute, such as volume or number, is held 
constant while other attributes, such as shape or space, are changed. 
Studies have substantiated Piaget's findings in quite diverse cul- 
tures. They have also revealed some interesting cross-cultural dif- 
ferences. Tiv children (Pr!ce'*Will lams, I96I) achieved conservation 
earl ler than Wol of children (Greenfield, I966). Greenfield attributed 
this difference to a more manipulative approach to the environment on 
the part of the Tiv. Another finding, crucially Important to those 
involved in adult basic education across cultures, is that without 
schooling, qualitative change in the concepts of conservation appears 
to cease shortly after the age of nine. Thus unschooled adults in 
both Hong Kong and Senegal (Goodnow, 1962} Greenfield, I966) failed 
to perform better than nine-year-olds on certain tasks. Both Goodnow 
(I966) and Greenfield (I966) believe that the difference in schooling 
rather than lower "Intel I Igence'' explains the low achievement of 
these adults. Without the school's emphasis on abstractions there is no 
experience in abstract thinking or working ''in the head.'' The above 
findings strongly suggest that the non-formal educator provide 
unschooled or semi -schooled students with Immediate, concrete, per- 
ceptual cues and ample opportunities for "do-it-yourself" activities. 

Piagetian Studies^ Animism 

Although cross-cultural studies of childhood animism and 
related phenomena have failed to produce integrated findings, the 
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scattered bits of Information they have provided are highly provocative, 
Indian children revealed considerably ipore tendency than white children 
to assign life to "dead" objects (Dennis and Russel, I9AO; Dennis, 
1943), Indian children showed less artificial Ism (tendency to label 
objects man-made) than white children (Dennis and Russel, I9AO), 
Indian children established a dichotomy between rules for American 
games, which could be changed, and rules for their own games which 
they perceived as immutable (Havlghurst and Neugarten, 1955)* These 
findings point to a tendency to cling to traditional values when con- 
fllctlng systems exist side by side. Thus leaders Involved In non- 
formal education may find that even while they are granted special 
roles as authority figures, the procedures they introduce may be quite 
peripheral and ineffectual In the Indigenous society. Part of the 
educator's task will be to facilitate the Integration of novel elements 
Into the mainstream of the receiving culture, 

Intel I Igence 

For several decades there has been interest in developing 
"culture free" intelligence tests so that whatever these tests 
measure can be measured cross-culturally. Studies based on such 
diverse populations as Fox Indians (Carney and Trowbridge, 1962), 
illiterate Syrian Bedouins (Dennis, I960), Mexican-Americans (Carlson 
and Henderson, ^950), and American Negroes (Shuey, 1958) have sug- 
gested that "culture" Is extremely Important In Intelligence testing 
and that to date cultural factors have not been adequately accounted 
for In such testing. True cross-cultural comparisons of Intelligence 
are not possible at the present time. This does not preclude the use 
of tests standardized within cultures as predictors of school success 
or of success In certain occupations. They may also provide a basis 
for useful ability groupings for teaching and experimental purposes. 
They might prove to be measures of the "modernization" of a population, 
or predictors of the acceptance which certain educational innovations 
could expect. Comparative Item analyses of easy and difficult test 
items within cultures would be revealing. However, It should be 
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remembered that what intelUgence tests measure is closely related to 
school success. Their ability to predict the success of non-schooled 
persons in semi-si<i11ed or sl<i11ed occupations is probably limited/ 
Many of the learners participating in ''non-formal education" would 
fall into this category. 

Sociological and Communication 
Research Traditions 

Motivation for Learning 

Relating to motivations for education is Brembecl<'s (1965) 
survey interview of 125 parents, teachers, headmasters, school 
inspectors and other middle level administrative personnel, high 
level education personnel and Americans assigned to overseas education 
missions of various types in India, Pal<istan, and the Philippines. He 
found that there were four sources for educational aspirations: 
(1) a dominant parent or another person of his l<in group who often 
was illiterate or had little schooling, (2) a person who serves as an 
"educated model" for either the dominant adult and/or the child, 
(3) a drive for economic betterment, and {k) an anticipation of 
respect, acceptance and influence from his l<in group. These findings 
suggest that there are numerous social, economic and psychological 
forces which are pressing the uneducated masses to achieve an educa- 
tion. Within the minds of these people education has great economic 
and social "payoff." They expect to better themselves financially 
and socially. It becomes imperative that education be related to the 
fulfillment of these aspiration-needs to the degree it is capable* 
Certainly no education can guarantee greater social acceptance. 
Education can, however, provide the technical and cognitive skills to 
enable a person to achieve a socially acceptable job which will enable 
him to rise above economic enslavement. 

Instructional Media 

Regarding the question of instructional materials and especially 
instructional media, there are numei^ous findings which are germane. 
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Schramm (1962) complied the results of 393 experimental comparisons of 
television and classroom methods In schools and colleges in mathe- 
matics, science, social studies, humanities, history, literature, 
arts, language skills, health and safety. I^ls summary shows that 83 
experiments gave significant results for television teaching, 255 
showed no significant differences between television teaching and 
regular classroom teaching, and 55 showed a significant result in 
favor of regular classroom teaching. He states that "it is apparent 
that television has been used for instruction vfith about as much 
success, over-all, as ordinary classroom methods." Schramm's data 
suggest that success of television, however, is inore likely for 
younger children, third through sixth grades, and in math, science 
and language skills. Television is as effective as a teacher and 
sometimes more effective under certain circumstances. That rather 
technical subjects, such as math and science, could be effectively 
taught by television, gives some indication of the wide breadth of 
subjects available to televised education. 

Television has been found to have the highest credibility for 
news (see Weiss for list of eight studies). The acceptance of 
television's credibility is a general pattern across cultures (Blumer, 
1969 and Starck, 1969) Independent of the use of other media. Tele- 
vision Is also chosen by the general public as the primary source of 
general information (Roper, 1969). These findings, along with 
Schramm's observations on television teaching, suggest that this 
medium is a highly potent force for non-formal education. Ethiopia 
demonstrates an example of television usage for educational purposes. 
By 1966 thirty-seven educational programs were broadcast weekly and 
within Just two years television set ownership Increased by tenfold 
(Patterson, I966). No other medium can boast of such rapid expansion 
and such a highly credible acceptance. 

Henry Cassirer (1962) points out an alternative possibility 
for the use of television in education. He notes that it might be 
prohibitive to seek to install a television set In each primary 
classroom in each developing country. However, television, with all 
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its attendant positive attributes as a powerful coininunication niedium> 
could be used to train teachers. The result would be a multiplica- 
tion of better trained teachers and a reduction of the effects of 
television's handicap, its mechanical non-human characteristics. He 
suggests that television be used not solely for pre-service teacher 
training, but also for in-service training. The implications for non- 
formal education are clear: teachers (including technician-level 
agents) can be trained through the television medium by both precept 
and example and then dispatched into their own local areas to 
multiply themselves. 

Media Forums 

Regarding instructional media and delivery systems, the find- 
ings in several countries on radio and television media forums have 
high significance. The studies in Canada (Nicol, et al», \S$k) t 
Prance (Schramm, 1964), Japan {Rural Television in Japan, I960), 
India (Mathur and Neurath, 1959). and Italy (Tarroni, 1962 and 
Puglisi, 1962) all confirm the exceptional effectiveness of combining 
a mediated presentation with local, small group discussion immediately 
following. This method seems to tal<e the best from several worlds: 
the expertise of a Icnowledgeable person presented on the mass medium, 
the high credibility of television, the informal interaction of face- 
to-face group processes and the reinforcement received from group 
decisions to act. Rogers and Svenning (1969) give several pages to 
a thorough discussion of various types of media forums, their 
advantages, effects, rationale, and their relation to interpersonal 
communication. For over a decade various countries have been using 
media forums for teaching a wide variety of subjects with high success 

Diffusion of Innovations 

Relating to the issue of specifying learning tasks, the 
findings of Rogers (1962) and Rogers and Svenning (1969) are signifi- 
cant. Rogers and his numerous associates have sought to identify 
those people who most lil<ely will adopt a new idea or innovation 
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through contact with vaHous change agents (for example, teachers, 
extension agents). Rogers' conclusions are based on various research 
surveys In Colombia (Rogers and Svennlng, I969) and In Thailand 
(Rogers, et aiw 1969). Adopters are classified according to the time 
of their adoption of the Innovation. Adopter categories are quite 
similar across cultures (Rogers and Svennlng, 1969). Innovators and 
early adopters score highly on modernization variables of literacy, 
aspirations, cosmopo) iteness, mass-media exposure, social participa- 
tion, change-agent contact, and higher education attainment. In 
order for non-formal education to be successful, there must be the 
adoption Into overt behavior Of the learning tasks. The adopter 
categories provide an easy check- list of those within a given social 
system (target population) who will most likely adopt earlier than 
others. Thus the educator can focus his attention on the right 
groups of people. Also, Rogers' studies provide additional guide- 
lines for change agents. That his studies have been in dissimilar 
cultures and countrle&> suggests the essential transcultural nature 
of the mechanisms of change. The non-formal educator would be wise 
to review these findings and seek to apply them to his own particular 
country and target population. 

Social Sex Roles 

In relation to the target population. It would be wise to 
keep in mind that the two sexes do utilize different skills and 
abilities of learning, even when the learning tasks are similar. 
Conditions under which males perform optlmumly are not the same as 
those for females (Garsi and Schelnfeld, I968, summarize kjk 
references to sex differences In learning). The communicator In non- 
formal education must seek to know how learning differs between the 
sexes. He must also seek to tailor-make his teaching- learning 
experiences according to these differences. This is compl Icated when 
both sexes cannot be segregated or when the subject matter, e.g., 
literacy, appea1s«to both sexes. In these situations, the teacher 
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must be able to provide experiences that wit) maximize tlie learning 
<;onditions for both sexes. It may be extremely difficult for some 
men to teach women and vice versa « 

Classroom Structure 

Avtia, et al.f (1968) reports that culturally and economically 
disadvantaged school children benefited more than advantaged children 
from more structured classroom settings. They explained thes9 
results by observing that disadvantaged children had more freedom 
outside of school than they could successfully cope with while, by 
way of contrast, advantaged children lived within a more structured 
environment. Tlie significance here is that sufficient structure is 
needed in a learning experience to provide guidance, but that the need 
for more or less structure is related to socio-economic factors and 
to learning styles. The educator must therefore be well aware of his 
target audience's characteristics as he plans the learning environment 
and pedagogical styles and media. 

Elaborated and Restricted Codes 

Bernstein (1569) adds another dimension of the understanding 
of a target population through his study in England of elaborated and 
restrictive codes and their relation to social origins, liis socio- 
linguistic approach seel<s to provide some help in understanding how 
one's social setting pre-determines the way in which one decodes and 
encodes messages. It is his conclusion that the lower or poorer 
class uses a restricted code in which syntax and vocabulary are 
greatly limited, thus allowing for a certain degree of predictability. 
In the upper classes, there is an elaborate code in which syntax and 
vocabulary are chosen from a broad range of possibilities, reducing 
the predictability of a given communication. Schatzman and Strauss 
(1966) report basically the same findings in their comparison of 
lower and middle class encoding of a natural disaster in the State of 
Arl<ansas in the U.S.A. It appears then that the socio-cultural- 
economic statu» of the person involved in a learning situation will 
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greatly affect his ability to comprehend communication aimed at him 
and his ability to communicate to others. Also, Schatzman and 
Strauss suggest that the individual displays his modes of thought 
through his communication behavior, it is, therefore, necessary 
for the teacher to **get inside of** and empathize with the learner in 
order to understand how the various messages to and from teacher and 
to and from pupils are received. The teacher from another culture 
surely has this problem, but the teacher from another social level 
from within that same culture also has that same difficulty. 

The Emerging Understanding of Cognitive 
Differences; Implications for 
System Design 

The term *'cognitive style" has been used to suggest the 
particular way a person's mind operates in the processing of ideas. 
The main use of the term is in reference to differences among people's 
approaches to information and differences in their modes of mental 
processing. The term encompasses all sorts of differences, no matter 
what their origins. The concept "cognitive style" owes its respect- 
ability to a social -environmental view of mental development; it 
relates to the sorts of differences in functions and uses of the 
mental processes which can be attributed primarily to experience (in 
contrast with genetic heredity). Thus for the student of cross- 
cuUqral communications and education, differences in cognitive style 
are of great concern since what the culture and physical environment 
have caused the learner to become must be l<nown and understood if one 
is to reliably plan and design effective learning experiences. 

People from different cultures respond differently to similar 
situations. Different people perceive or interpret a perceived 
situation differently, and therefore respond in what they consider to 
be the appropriate way. In the search to specify why and how these 
differences occur there have been several approaches. 

One earlier approach made by anthropologists was with the 
concept of "ethos." Ethos was conceived of as a general orientation 
of a culture to respond in a given way by structuring its customs and 
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institutions according to one guiding principle. A contrasting pair 
of these principals were the Dionysian and the Apol Ionian* the free 
and indulgent as against the controlled and ascetic, later when this 
course did not prove fruitful the idea was that there were multiple 
'*themes'i in a culture which served to pattern the institutions and 
explain the variabil ity within the culture. 

Another way of attacking the problem was through the Sapir" 
Whorf hypothesis: language structures a personfs thought, perceptions 
and reflects a specific world view. As such, those who speal< a. 
certain language are programmed to categorize situations in determined 
ways, and to respond accordingly. Some studies have been done at the 
morphemic or vocabulary level with no positive results. This approach 
can be questioned from several standpoints. Why do different sub- 
cultures using the same language respond differently. If they use 
the morphemes in common? Vocabulary is the most transient part of 
language. While It is true that it provides the categories for 
ordering and expressing perceived experiences, the categories are so 
elastic and transient that they could not be determinants in any very 
strong sense. Word categories overlap (synonyms), change rapidly, 
expand, alter focus in different contexts, and at times become 
almost meaningless due to the wide range of referents (e.g., science, 
freedom). One experiment showed that they were not determinants in 
Itfflittng perception. In a language where colors were categorized in 
broad categories, so that there were no separate terms for red and 
orange, people could nevertheless distinguish different shades quite 
easily. If the morphemic level is not adequate for determining thought, 
possibly it is at the syntactic level, where categoreis are ordered, 
that accounts for the differences In responses. Syntactic structures 
are much more stable than morphemes. Linguistic contrasts that 
suggest this possibility are reviewed by Glann (1966). 

But still, the same words can be used to express different 
world views. Words play a reciprocal role with experience. As a 
word is used in different contexts, its meaning changes for the 
individual. It is in this way that a language can be used to teach 
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ideas that are new, and even at odds with the accepted world view of 
the individual, but it can be done. The diffusion of Buddhism, Islam, 
Christianity and Communism testify to it. Still one might react and 
say that in each case, as the religion has diffused, it has been 
modified by the culture to which it has gone. But in e;<actly what 
way have tliey been modified? Have they been completely changed, or 
do the basic concepts remain, clothed in some of the trappings of the 
receiving culture? In any case, words are both determinants, and 
determined by the experience and use. 

In earlier writings, we have suggested six levels for mal<ing 
a functional translation or adaptation of pedagogical materials: 
Level I, languag e is conceived of as more or less straight translation; 
Level 2, adjusting vocabulary deals with mal<ing the complexity and 
difficulty of the style to agree with the level of the target audience. 
The Level 3, changing illustrations has to do with adopting the images 
and figures to ones within the experience and traditions of the target 
audience. The last three levels, 4, adjusting to pedagogical 
expectations . 5, recasting the content to reflect the world view , and 
6» adjusting to the learning styles seem to overlap. There is a real 
question as to whether, after having transferred materials on the 
first three levels, there is enough residue of difference that it would 
be possible to identify and use such differences in any objective and 
consistent way in the further modification of the materials. 

Learner expectations possibly differ radically with respect 
to the subject matter. Due to the spread of western education around ' 
the world, academic subjects (and the prestige they carry) are 
expected to be learned in the complex of the "school." This category 
or complex of traits includes teachers who l<now, students who are not 
expected to l<now, bool<s, blackboards, rows of chairs one-way communi- 
cation, administrators, gowns for teachers, uniforms for students, 
dormitories, dining halls, examinations, grades, scholarships, etc. 
That which does not include enough of these traits to identify the 
complex is interpreted as not being a real school, even by those who 
have never been to school. On the other hand, learning to operate a 
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tractor or to repair a motor would not fall within these school 
expectations, and consequently can be learned In other contexts 
without conflict— but also without the prestige. One wonders If 
the reason programmed Instruction has been so useful In Industry and 
the military might partly be that they must teach, but are not 
expected to be a "school," and therefore can "legitimately" use any 
method that works. 

Thus we come to the possibility that the compartmental Izatlon 
of expectations and world view with respect to different aspects of 
life Is, In Itself, basic. If a world view Is a set of assumptions 
about reality that a person u!>es to organize and Interpret situations. 
It may be quite possible for a person to operate with different sets 
of assumptions for different aspects of life. For Instance, a person 
from an animlst society might learn accounting or electronics and 
operate within one set of assumptions for his work, while at the 
same time using a completely different set when In the context of 
illness or family affairs. It Is undoubtedly impossible to keep these 
compartments completely separate In different role assignments, and 
this leakage would account for the types of conflict portrayed in the 
"cargo cults" and similar movements. In some individual cases and 
in certain societies where roles are kept rather well Isolated, It Is 
possible to maintain the relative Isolation. A familiar case Is the 
man who is a "rel Iglous person" on Sunday, but reverts to the dog- 
eat-dog business ethic during the week, where the office role and the 
church-member roles are kept separated. 

If this compartmental izatlon Is real. It might well be that In 
each area of life, certain learning expectations occur, therefore 
certain institutional and teaching strategies may require modification 
if the appropriate expectations are to be fulfilled. Conversely, if 
these expectations are not conducive to adequate learning, it may be 
appropriate to try to alter the expectations in order to teach 
effectively. The extension theological education program might be 
rationalized in this way. 
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Studies reviewed by Bruner and his colleagues (1972, Relevance 
of Education, chapter 2), Indicate a notable difference In the mode of 
thinl<ing between those who are literate and those who are illiterate 
in certain African societies* The individual does not seem to brealt 
away from what Piaget calls "concrete operations" to use "formal 
operations" until he becomes literate, Being forced to abstract 
language symbols on another level, and having to order them in 
writing changes thinl<ing to "formal operations." According to Piaget, 
as a person moves f|*om one stage to the next, he does not cease com- 
pletely to thinl< in the earlier modes, but builds on these, so that 
certain categories are still carried on in the former stage. The 
modes of thinl<lng associated with certain areas of activity or role 
assignments may be so that an individual might deal with accounting 
or electronics on the level of formal operations, but sicl<ness, or 
religion on the level of concrete operations or preoperational modes. 
This may be the difference noted between Hebrew and Greek thought; 
for Instance contrast Proverbs with Romans in the Bible, or African 
proverbs with the physics taught In public schools. 

In those areas of life in literate societies, where a person 
concentrates most of his activity and effort. It Is 1tl<e1y that he 
will use formal operations, and will be more liltely to modify his 
behavior. This conclusion Is consistent with Bruner's contention 
that traits learned earlier In life are more resistant to change than 
those learned later In life. 

Conclusion 

"Cognitive style" may In fact be essentially a manifestation 
of the person's perceptions reality (world view) and the way he com- 
bines these perceptions (formal, concrete operations) to Interpret and 
respond to a given situation. The set of assumptions that mal<e up 
the world view, and the operations that he used to combine and 
interpret them may be quite different for the different roles the 
Individual plays. The expectations for appropriate learning situations 
may also correspond to each of these role sets or areas of life. 
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Human Resources? The Key to the System 

The "radical school movement" in the United States believes 
that significantly better schools will have to be radically different 
schools. But the overriding concern of the developing nations deals 
not with better but with enough schools and schooling for those for 
whom no school has been provided and in providing relevant education 
for their industrially developing economies. In order to anticipate 
the problems that American and European schools have encountered, the 
criticisms, theories and practices of the radical educational reform 
movements should be considered now in the developing nations. Thus 
they might avoid ultimately coming into the dilemma in which education 
in America finds itself. No one should claim that "more of the same" 
will bring progress and development to nations that adopt western- 
style formal educational structures and procedures. Many have found 
them 'Macl^ing." 

The policy of investing more aid overseas in formal, elitist, 
and traditional structures is being called into question. For some 
of the same reasons here in the United States, Objections are also 
made to further propagation of formal schooling. The inability of 
many municipal i ties to pass their bond issues is interpreted as public 
non-support of the status quo* in the United States, urban ghettos, 
black or chicano leaders want radical political reform, they want to 
control their schools. The radical reform theorists such as Goodman, 
Friedenberg, lienry, and McLuhan see the schools as agents of a sicl< 
society majoring in "suppression, irrelevance, inhumanity, manipulation 
and the systematic stultification of what is most promising in youth" 
{Radical School Reforrnt p. 17)* The radicals propose a dismantling of 
the whole school systems and a complete remodeling or remalcing. 
Charles Sllberman in Crisis in the Classroom examines the present 
dilemma of American education. I^e criticizes the failure of the 
public school to contribute to "facilitating the movement of the 
poor and disadvantaged into the mainstream of American economic and 
social life" (p. 53) « Though there are other serious problems in 
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formal educat)on» economic and social concerns should be of special 
interest and study to proponents of non-formal education in the 
developing nations. 

Sllberman levels criticism at the massive reform movements of 
the 1950's and 1 960 's and admits though "the reform movement has 
produced Innumerable changes, ... the schools themselves are 
largely unchanged" (p. 159) • He explains that substantive reform 
was not attained because the reformers Ignored the experiences of 
the past reform movements and either ignored or failed to understand 
the "harsh realities of classroom and school organization" which 
affect the ways teachers teach and schools operate (p. 180). 

Non-formal education must be forewarned If It Is to fulfill 
Its promise to provide alternatives that are not schooling for 
schooling's sake. The training of human resources for non-formal 
education Is a basic Issue. What sort of learning environment Is apt 
to be most effective? What kind of a teacher is needed for the non- 
formal educational environment? How should he or she function? 

If learning is truly motivated within the learner, then he 
should be given the right to decide what he wants to learn, and when 
and how he wants to learn it. This can be qualified by affirming 
chus the teacher functions as a resource person, helper, guide, 
encourager and consultant, and not necessarily as a transmitter. 
Judge and authority. These assumptions underlie Paulo Prelre^s con- 
tentions that the content of "themes" used to teach Illiterates must 
be highly local and originate with the students, and the trained 
illiterates or semi -1 Iterates should be the teachers of illiterates. 
According to Freire, these conditions constitute the only really viable 
method for raising peasant masses "from oppression to freedom." 

The teacher technician or agent In the non-formal mode of 
education must help people to improve In their ability to learn, to 
acquire knowledge, and especially to be able to ask and*answer 
important questions themselves. (Education too often occupies Itself 
in answering questions no one Is asking!) 
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Effective learning, regardless of the setting, implies per- 
formance of a given goal. The emphiasis in non-formal education lies 
In the area of practicality and in functionality, its value can be 
determined in terms of the utility of the learning it produces. It 
is not "schooling for schooling's sal<e" but schooling for education 
or learning directed to specifics or goals concerned with improvement 
of social and personal living, occupational capability and vocational 
competency. In the non- formal setting, it would seem that the learning 
to be achieved is directly related, not only to society as a whole, but 
also to the individual. Thus the teacher or leader should possess: 

1. The ability to involve the clients ("students" or 
"learners") in an analysis of their higher aspirations 
and the changes necessary to achieve them; 

2. Ability to diagnose any obstacles that must be overcome 
in order to ach'eve changes; and 

3. Planning of effective strategy for accomplishing the 
desired results (Knowles, p. 3^). 

Who should be trained as a teacher or leader for non-formal 

education? Academic subjects can be taught by the person produced by 

the formal educational institutions. But is there adequate correlation 

between school performance and life achievement? Gross contends that 

for children up to twelve years of age there is necessity of formal 

subjects or pre-arranged curriculum and that any benevolent grownup* 

literate or illiterate, has plenty to teach an eight-year old. 

Further, he argues that the only profitable training for teachers is 

a group therapy and, perhaps, a course in child development (Gross, 

p. 100). 

Preston R. Wilcos (in Gross, p. 125) writes about the community- 
centered school and outlines a program committed to learning for use, 
developing a sense of functional curiosity, and the participants' 
assuming a large part of the responsibility for developing their own 
intellectual resources. The community learning center is intended 
to become the facility where the community begins to meet its latent 
needs for recreation and fun, where it begins to formalize its efforts 
to express itself through art, music, drama, etc., the locale for 
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shaping community pot icy as it relates to housing* traffic* health* 
education* and other social issues* and the arena for developing and 
implementing mutual-aid programs designed to aid the less fortunate in 
dealing with their problems (Gross* p. 129)* Certain key problem areas 
in non-formal education can be taught and/or shared by persons who are 
doing the l<inds of things they are to teach. In some cases* a member 
within a given group may be selected by that group to leave the com- 
munity in order to learn a given sl<i11 and then return to the group to 
teach the others what was learned. 

How is the teacher trainee to be selected? Two or more of the 
following attributes are desirable in the trainee: 

1. Knowledgeable in the subject matter and a successful 
practitioner of his subject or skill; 

2. Enthusiastic about the subject and about teaching it; 

3. Understanding about people (personality traits of 
friendliness* humor* humility and interest in 
people); 

Creative in thinking about teaching methods and 
witling to experiment and innovate to meet changing 
needs and interests* 

5. More concerned with the development of the individual 
than with Just a presentation of facts; and 

6. Respected in the community or occupation group 
(adapted from Knowles* p. 163)* 

trends and Implications for 
Educational Manpower 

The human resources factor— faculty and staff— is the most 
costly factor and represents from 60% to 30% of total cosits in a 
given educational system (Coombs* 1968* p. 89)* In reality* education 
is one of the last widespread "handicraft" extant in the modernizing 
world of today! A crisis of educational economics is being faced 
in many nations and of course, the biggest problem is the cost of 
human resources. 

It is anticipated that teacher costs in the nqn'*formal sector 
will be considerably lower than in the formal sector. The possibility 
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of packaging the training and using various film and tape media will 
also result in lower costs due to mass production as well as to the 
fact that they can be delivered by lower paid amateurs or technician 
level teachers. 

Philip Coombs attributes the educational crisis— worldwide but 
particularly difficult for the developing nations-*to (1) the student 
flood, (2) acute resource scarcities, (3) rising costs, (V) unsuit- 
ability of output, and (5) inertia and inefficiency (Coombs, 1968, 
pp. 164-165). This crisis in turn has arisen largely because of the 
increased social demand for education. Children and parents express 
increasing aspirations for education to improve their financial lot 
and status while governments see education as a precondition for 
overall national development. The "democratic imperative" for 
increased political participation also puts great demands on education. 
Behind all of these pressures is the rising population rates (Coombs, 
p. 18). 

"Schools are remarl<ab1y clumsy instruments for inducing large- 
scale changes in underdeveloped areas. To be sure, formal education 
has had immense impact in Africa, but its consequences have rarely 
been those anticipated, and the schools have not of ten functioned in 
the manner intended by educational planners" (Foster, Education and 
Economic Development, p. 142). 

Implications of the pressures on the educational sector 
include suggestions about the selection, preparation and assignment 
of teachers and technicians in non-formal education: 

1. Vocational and technical training should be done 
mainly outside the formal schools (training should 
be 1inl<ed to on-the-job experience). 

2. Training should be designed and operated as extensions 
of worl< situations. 

3. The labor needs of existing industrial and commercial 
firms should be used as a pritpary motivation. 

4. Government, generally the single largest employer 
of skilled labor, should develop technical training 
related to its needs. 



00121 



5« Instruction should be made available to assist in 
simple business procedures for the local small-scale 
entrepreneurs who are involved in trade» commerce , 
transport and small scale manufacturing. (They are 
sometimes the forgotten sector in development plans.) 

6. Training for artisans and technicians should be 

provided (adapted from Foster in Anderson and Bowman, 
1965, p. 158), 

Foster analyzes the problem of agricultural training, advo- 
cating that agriculture education must be directed toward the farmer 
himself and not toward school pupils* He writes, "Any attempt at 
agricultural training presupposes that a meaningful structure of 
incentives exists for the individual farmer to increase his output, 
improve his techniques, and expand his range of activities. Without 
such incentives and opportunities, agricultural education can have 
little impact, instruction must go hand in hand with changes in 
those institutional factors that militate against innovation. 
Clearly, an important area for investigation is the functional impact 
of traditional systems of land tenure in retarding development. It 
might be argued that the emergence of the concept of land as an 
individually owned resource, freed from traditional restrictions upon 
alienation and transfer, could do more than anything else to facilitate 
the emergence of progressive farming" (Foster, 1965, p« 159)* 

The following model Is suggested as a conceptual frameworl^ for 
the development of human resources In non-formal education. It sug- 
gests questions regarding the relationship of the teacher, leader or 
trainer within the total system's design. 

The essential difference between sets A and j9 In Figure 7 Is 
of degree rather than l<{nd, both sets (rows) are 3-element llnl<ages. 
Here we must ask who the master-teacher should be and what he Is to 
do. (We must not forget: that peers learn effectively from one 
another and can be utilized In the role of mutual teaching.) 

The master-teaciier should preferably be a professional In the 
content area he Is to teach} a sicllled tradesman or craftsman who has 
the ability to communicate with potential learners; a knowledgeable 
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Technician as Facilitator of Delivery 
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Figure 7. "The Teacher as Interface Between Content and 
Learning. 
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person who works at or In the area In which he will Instruct other 
teachers. The master-teacher will likely be found wherever the skill 
or competency Is practiced. 

Vf) master-teacher needs to train teacher-candidates utilizing 
the methOiS he expects them to use. This Is not Just a matter of 
demonstrating teaching but teaching by demonstrating! The nature of 
the knowledge or skill to be taught should determine the method, 
ilere Is the value of on-the-job training and practlce"learnlng the 
skill by practicing it. 

One of th^ most critical areas to consider in developing 
personnel for training responsibilities is the environmental context 
of the training task. Whether the trainer needs to operate within the 
structure of an organizational system of a school or governmental 
agency, a social or community entity (private agency, church, etc.) 
or an industrial or commercial establishment does not alter tha basic 
need for relevance of the learning experiences. They should occur 
in meaningful context. 

In tlie process of selection, the manager should evaluate 
candidates in terms of their standing before peers within the community 
or occupational group. Who is the person who exercises influence over 
people in a given group system or community? This will be the person 
(or the designator of the person) who can be most successful in per- 
forming the training task. Rogers writes that ". . . success or 
failure of programs of planned change depend ultimately upon the 
ability and cooperation of local leaders at the village level." 
Though a teacher may be technically competent, his influence may be 
rendered relatively ineffective without the respect and status of the 
groups. Rogers also indicates the importance of the similarity of the 
"change agent" and the target population. If most of the clients In 
a target system only possess two or three years of formal schooling, 
a university trained change agent will face greater communication 
difficulties than if he had less education (Rogers, p. 181). Thus 
agents of non-formal education should be selected who are as similar 
to the client group as possible. "Evidence for this statement comes 
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from a study by the Allahabaci Agricultural Institute, tadra Village 
level change agents with only an elementary education were more 
effective In reaching Indian villages than were change agents with 
high school and university education" (Rogers, p, 181). 

The importance of peers, one-teach-one approaches, and 
Influences through the family take on extra credibility in light of 
experiences within the field of education of the handicapped. 

Karnes suggests that "the best hope for raising IQ and achieve- 
ment levels of disadvantaged children may be to train their mothers 
and older brothers and sisters to teach them— but what they teach 
must be cognitively oriented and highly structured" (Karnes, information 
Network'SERVICEf April 14, 1972). Karnes observes that for low-Income 
and exceptional children, one year of intervention is not enough to 
make substantial and lasting gains no matter how much gain the 
children make. Her own program, stressing verbal responses and 
information processing produced high IQ gains, \k points, at the end 
of the first pre-school year. The gains began to dwindle, especially 
for the brightest children, until by the end of the first grade there 
was no appreciable difference between her program and a regular 
kindergarten . The conclusion of Dr. Barnes is that trained amateurs 
may be the best hope for long term gains because this will permit a 
low pupil-teacher ratio which is what these children need. In this 
situation, the paraprofessional knows precisely what she is supposed 
to do, she can evaluate her effectiveness immediately by seeing the 
child perform the defined task and she can see the results of her 
work in the day-to-day improvement of the child. One program that 
produced substantial long-term effectiveness involved a six to eight 
week tutoring period by 12 to 16 year olds for their little brothers 
and sisters. The key to implementing such programs is the effective 
trainer of paraprofessionals. 

Four configurations of relationships among learners can exist, 
depending on tha structure of the learning relat ionshipt 
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). Peers can compete as isolates (solo participation in a 
correspondence course) 



- Learners in Isolation 

0 0 0 

2. Learners as Peer Competitors (competing for grades» 
status) 





3* Learners as Sequenced Peers (ohe teaclies two» who 
teaclies tliree, etc.) 



0 .0 .0—0 



k. Learners as Mutually Responsible Peers. 




In terms of learning effectiveness tlie tliird and fourtli 
models ar^ superior and are becoming more common^ especially witliin 
industrial and military training. 



Guidelines for Effective Learning 

Tlie paper lias demonstrated the complexity of the problem of 
planning for effective learning. There is no way to simplify the 
ta8l<s» it is only possible to make them more clearly defined and to 
arrange them in convenient and scientific sequences. Baste to these 
sequences and to the designs which they will enable are several 
understandings. Designing effective learning in non-formal modes 
depends on these understandings. 
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Understanding the Historical 
and Cultural Sources 

Within every society there are sources in the traditions and 

the value systems that have given rise to what education has become* 

That which a culture has produced cannot be overlooked in the planning 

of something new. Whether education is a matter of elaborate 

institutional i zed efforts or merely the simplicity of familial and 

tribal Influences, rituals and indoctrinations, the sources are in 

the history and in the cultural milieu of the society. Before 

attempting to augment or significantly alter the educational resources 

of a community, region or nation, these sources must be examined and, 

to the extent possible, understood. Such understanding is necessary 

If new non-formal resources are to be designed in such a way as to 

have an ultimate accommodation (interlocit) with the existing formal 

and informal systems of teaching and learning. With reference to these 

factors a guideline is offered: 

I. For effective learning, non' formal education should 
be designed to interlock into the cultural and 
historical traditions of a society* 



Understanding the Target 
Populations 

Of all the many variables in an instructional system, the 

target population is likely to be the most complex. The three sets 

of factors that must be understood are (I) the motivations that 

drive the learners and the sorts of psycho-socio-economic rewards 

that will sustain them as learners; (2) the habits and expectations 

that their previous learning experiences have induced; and (3) the 

styles of mental processes and learning characteristics that have 

been induced by previous formal and informal learning experiences. 

With reference to the first set of factors a guideline Is offered: 

II. for effective learning, non-formal education 
should provide experiences for which there ia 
a practical use» 
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Education without an outlet for the learning Is useless. 

Incentlvos for learning should be perceptible to the learners and 

should be specifically rewarded within a relatively short period of 

time. The second set of factors also suggests a guideline: 

171. For effective learning, non'-form&l education 
should utilize instructional procedures that 
are recognizable to the learners as being 
learning experiences. 

This guideline can be interpreted as suggesting that only "old" 

methods should be used; however, there are many occasions wherein 

learners can be carefully and gently re-educated to recognize the 

learning potentialities in new procedures and forms. Thus It is 

possible to introduce new media and methodologies if the design 

provides for the necessary re*education needed to accept the new 

procedures. 

The third set of factors suggests another guideline: 

IV, For effective learning, non" formal education 
should employ instructional materials designed 
specifically for the dominant characteristics of 
the learning styles and mental processes of the 
learners. 

Since the dominant characteristics of learners' styles are 
largely in common within a society this is a realistic guideline. 
Not enough is l<nown about cultural guidelines. Not enough Is l<nown 
about cultural factors that affect learning style; thus we cannot be 
sure that we are talcing everything important Into account* but there 
are a few highly significant continue or axes, such as the distinction 
between global and articulated cognitive styles, that do have high 
relevancy for the design of instructional materials (IHovey, 1971)* 

Understanding the Administrative and 
Managerial Demands of an Instructional 
System 

The instructional system consists of far more than a plan 
for the delivery of educational resources. Perhaps even more 
Important than the delivery system itself Is the management and 
evaluation of the system. With reference to this matter two guide- 
lines are offered: 
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V» For effective Xearning0 non-fom&X eduontion 

should be designed to operate within a management 
system capable of correlating hman and physical 
resources as well as articulating all potentially 
contributory agencies, 

VI, For effective learning^ non-formal education 
should operate within an evaluative structure 
that provides data for continuous improvement 
of the instructional procedures. 

An instructional systems approach to non -formal education 
accepts the view that objectives are as important as procedures. 
Many programs of formal education are a result of valuing the per- 
petuation of procedures more than the achievement of goals. It is 
recommended that non-formal education be planned so as to respect 
the relationship of objectives and procedures indicated following: 

l« Mal<e a general statement of the problems and/or needs 
to which the non-formal education is to relate. 

2* Mal<e a statement of goals and objectives for meeting 
the needs. 

3« Determine and operate a set of procedures that will 
1il<e1y achieve the goals. 

4. Carry on a continuous evaluation and modification of 
procedures to assure that they achieve the goals. 

5. Periodically assess the problems and needs in order 
to modify the goals and objectives of the system. 

In such a relationship, the procedures of the system are less 
important than the goals; and the value of the goals is dependent on 
their relationship to the reduction of problems and the meeting of 
needs. As needs and problems change, the goals and objectives must 
change. As evidence indicates that goals could be better met, the 
procedures are changed. 

Summary 

No simple response to an educational need— whether format or 
non-formal — is apt to be adequate. 

Designing non-formal education that will lead to effective 
learning is a complex task. The relationship of the learning 
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experiences to the learners' characteristics and life experiences 
constitutes the most demanding problem* Almost as complex is the 
problem of developing an administrative and evaluative frameworl< 
adequately assuring the continuous refinement of the system. 

Postscript; The Ecology of the 
Formal ity In Education ""^ 

Taken as a whole, schools constitute the major educational 
institution in the typical industrialized nation. As such, schools 
serve the typical sociological function of an institution: they 
stabilize the society. The stabilizing effect is generally seen as 
the result of essentially conservative social roles. The society 
rewards and supports the institution in response to its effectiveness 
in preserving against disorder or other change. Because the status 
quo is "safe," in the sense that its problems are already familiar 
and accommodated, change is less popular. Schools are expected to 
maintain traditions. The challenging— much less changing—of the 
social order is a disputed role of the schools. 

Thus in an era of rapid social development and new techno- 
logical and political threats, the society's disuse of schools for 
social change becomes a liability. Reformers and social strategists 
attempt to place increasing loads on the schools; the status quo is 
challenged. Yet the schools remain stubborn. Despite the best 
efforts of well-meaning reformers and innovators, the schools persist 
in their academic traditions. What results is an increasingly 
violent swinging of the pendulum; to the left toward this change 
or that; to the right in reaction and righteous indignation; back 
and forth. Surely the citizen's view of hts schools must seem either 
confusing or hypnotizing. Many have come to accept this movement 
from one excess to another as an inevitable characteristic of the 
processes of rapid educational progress. Others, less optimtsticolly, 
see no particular progress, only the swinging bael< and forth. 

Much professional effort is invested in the improvement of 
schools. Even as Americans are an extension of the perpetual Western 
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search for frontiers, so are professional educators— particularly 
American educators- -searchers after the Improvement of educational 
e;<per1ences. One thing after another Is tried In the ever more 
costly search for school Improvement. A hallmark of the professional 
educator In the recent traditions of formal education Is an optimism 
and faith In the feasibility of improving schools. Perhaps no more 
unpopular hypothesis can be offered than this: certain character- 
istics of formal education are inherent and hence nd't subject to any 
permanent Improvement. 

A systems view of education considers the whole ecology within 
which learning processes occur. Thus when certain recurrent 
characteristics of schooling persistently show up"through history 
and cross-cultural 1y— we must at least consider the possibility that 
they are inherent and inevitable "rest states" of the schooling 
situation. 

It is beyond the scope of this paper to support any of the 
following hypotheses with data, but they may be useful to the designer 
of non-formal education. Since non-formal education offers the 
potentiality for designing learning e;<periences that avoid some of 
the weaknesses of formal learning environments, it may be important 
to be reminded Just what some of these weaknesses are. 

The following twenty items are drawn from the literature and 
experiences of curriculum development. Since each of these is so 
persistently and commonly a target of one or another of the "reform" 
innovations, it seems reasonable to suggest that some or all of these 
is an inherent, unchangeable characteristic of formal education. 

Sources of Weakness in the "Schooling" 
Approach to Education 

1. All learners are assumed to be similar in terms of 
needs, interests and abilities* 

2. Conforming behavior is preferred over divergent and 
non -con forming behavior* 

3. Learners are increasingly made more competitive at 
the price of cooperation. 
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learners are expected to be receptors of learning 
rather than communicators. 

5« The learner's part in decision-mal<ing is minimal 
and tends to be steadily reduced. 

6. The responsibil ity for attitudes and feelings about 
content and about learning itself is attributed to 
.the student. 

7* The content to be learned is Justified in terms of 
future needs of the learner. 

8. Schooling's major Justification is preparation 
(mostly expressed in terms of el igiol 1 ity for more 
schooling). 

9> Evaluation is concerned almost exclusively with 
cognitive learning (l<now1edge of information and 
processes) and sl<i11s. 

10. Learning experiences are designed or selected on 
the basis of values of the adult and established 
world. 

11. Abstractions of experience (in the fbrm of language 
and symbols) are substituted for realities. 

12. Rewards are symbolic more than real. Even the 
satisfactions of seeing oneself develop are sub- 

, ordinated to imposed systems of rewards. 

13* Punishment is assumed to increase learning. 

]k. Punishment is a virtually sovereign right of the 
teacher. 

15* The teacher is ascribed author ity» thus creating a 
hierarchy based on unearned status. 

16. The social distance that separates teachers from 
learners is Increased by according different sets 
of rights and expectations to each* 

17* Learning experiences are designed (and limited) to 
fit time b1oct(S. 

18. Learning experiences are designed (and limited) to 
fit standard locations and space. 

19. Testing is the criterion of success. 

20. Success is the surpassing value. 
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Each of these factors, alleged here to be threats to learning 
effectiveness, Is potentially present In any learning environment. 
To the designer of non-formal education goes the challenge of seel<lng 
ways and means of avoiding these threats. A careful systematic 
approach to the design of non-formal learning experiences can enable 
the designer to escape some or all of the threats to effective 
learning. 
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CHAPTER III 



RELATING INSTRUCTIONAL PROCEDURES TO LEARNER 
CHARACTERISTICS: AN EXPERIMENTAL 
ILLUSTRATION IN BRAZIL 



Lois McKinney and Ted Ward 



Learning effectiveness must be considered in reference both to 
short-term and to long-term effects. In the short-term, an instructional 
experience is effective to the extent that the following conditions 
pertain: 

1 . THE LEARNER IS AN ACTIVE, INVOLVED PARTICIPANT IN THE 
LEARNING EXPERIENCE, The experience is of sufficient 
interest to the learner to engage his learning process. 

2. THE LEARNER FINDS MEANING AND WORTH IN THE EXPERIENCE, 

The experience is organized and presented in such a 
way that the learner can comprehend it in reference to 
his present condition, needs, and background. 

In the long-term, an instructional experience is effective to 

the extent that these conditions pertain: 

1 . THE LEARNER CONTINUES TO LEARN AS A CONSEQUENCE OF THE 

EXPERIENCE, The experience initiates or stimulates 
learning processes that can and will continue to operate 
in the learner after the instructional experience is 
concluded. 

2. THE LEARNER FINDS PRACTICAL VALUE IN THE CONTINUING USE 
OF THE LEARNING, The experience provides knowledge and 
skills that will continue to have usefulness in life- 
changing ways. 

In any learning experience, formal or non-formal, the short- 
term effects determine whether or not the learner will voluntarily 
"stick with" the experience; the long-term effects determine whether 
or not the experience will "stick with" hi m l Since non-formal 
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education is typically concerned with practical and life-changing 
effects, it is especially important to consider the long-term conse- 
quences of the instructional experiences. To the scientist or evaluator, 
effectiveness of any given experience is of interest after the fact} 
but a designer or planner of an instructional experience is concerned 
before the fact. He wants to design or to improve the design of a 
learning experience so that it will be effective for the intended 
learners. 

As is also the case in formal education, instructional design 
in non-formal education is often a neglected matter— the assumption is 
made that if "competent teachers" are hired to deliver the instruction, 
in person or through media, effective instruction will result* This Is 
not a safe assumption. Especially in the sort of non-formal education 
that is detached from the mainstream of formal education, "competent 
teachers" may tend to use inappropriate instructional procedures that 
are based on their own previous experiences with formal education or 
with dissimi lar learners. 

Much attention should be given to the design of instructional 
experiences for non-formal education. Experiences in Brazil and else- 
where have convinced us that the procedures used to provide instruction 
tend, over time, to teach (acculturate?) learners in ways every bit 
as important as the content of those instructional experiences. 
Marshall McLuhan's contention that "the medium is the message" can be 
illustrated clearly in reference to the effects of procedures used to 
deliver instructional communication. Thus if problem-solving sl<ills 
and autonomous self-actualized learning are among the ultimate goals 
of a non-formal learning experience, it is crucial to avoid methods and 
procedures which will produce passivity and dependence in learning 
style. When the desired end result of a program of non-formal educa- 
tion is self-actualizing, autonomous, sustained learning or even the 
continuing use of specific learnings in reference to a changing series 
of problems or tasl<s, learning effectiveness must be viewed as the 
development and maintenance of certain characteristics of style or 
approach within the learner. The following table indicates the 
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contrasts between effective and ineffective learning in reference to 
four of tliese characteristics. 



Characteristics 
Evidencing 
Ineffective Learning 

disrespect for oneself as a 
learner; 

conviction that one can and 
does learn valid information, 
ideas and sl<i11s only when in 
the presence of a master; 

tendency to accept as unalter- 
able the ways things are; 
e.g., l<nowns are meant to be 
l<nowns» unl<nowns are meant to 
be unl<nowns; knowledge is a 
matter of accepting rather 
than of searching. 

assumption that learning and 
l<now1edge are abstract and not 
expected to mal<e direct impact 
on behavior. 



Characteristics 
Evidencing 
Effective Learning 

recognition and acceptance of 
one's worth as a learner; 

confidence in the validity of 
what one learns independently; 



tendency to inquire and to seel<; 
assumption that unl<nowns can 
become l<nbwns» 



expectation of being changed by 
what one learns. 



The interaction between instructional methods and content is 
also very important. Especially in those forms of non-formal education 
concerned with scientific and technological innovations, the grasp of 
cause-effect relationships and the capacity for relating principles to 
new situational particulars are essential elements for long-term 
effectiveness of learning. These sorts of learnings cannot be 
effectively acquired through simple fact-recall or rote procedures. 
The Science Education Programme in Africa has been struggling with this 
issue for several years. This project has been vitally concerned about 
consistency between content and instructional procedures in special 
reference to science. The Director, liubert Dyasi of Sierra Leone and 
Ghana, writes: 
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SEPA should also encourage a systematic collection of 
information on children's bacl<ground (especially as 
regards their ways of l<nowing) and of the significance 
of educational processes embedded in their culture, in 
order to aid both instructional strategies and 
evaluation.) 

The Experiment in Sgo Paulo; Its Oric|ins 

The study of a particular set of learners in an experimental 

program of non-formal is described in the following sections of this 

paper. A series of studies in "ethno-pedagogy," the cultural factors 

affecting teaching and learning, has been carried on at Michigan State 

2 

University for several years. The study reported here demonstrates 
the use of experimental procedures to discover ways to mal<e learning 
more effective in a given program of non-formal education. Although 
the study Is more elaborate and detailed than is feasible for many or 
most programs of non-formal education, the conclusions here have 
general applicability to non-formal education, and the experimental 
design, even if used only as a general model, could provide useful 
Insights during the pilot-project phase of any new program of non-formal 
education. 

That most Latin Americans are "rote learners," is a commonly 
accepted axiom among Latin American observers. Such simplistic 
generalizations, often based on an inadequate understanding of what 
one Is seeing, become stumbi jng-blocks to subsequent observations. What 
we thtnl< we saw becomes an expectation that can bias us to see It again 
the same way. This innocent selective focus Is stubborn*. It can begin 
with an explorer or a tourist and ultimately be reflected In the 
scholarly treatise of a reputable anthropologist. 

Because the stereotypes often arise from some local reality as 
viewed by an outsider whose perceptual framewori< Is different, the 
out$lder's conclusions are often reasonable enough to other outsiders. 
Even generous Insiders may be willing to accept the outsider's 
generalizations on a comparative basis, conceding that the outsider's 
frame of reference may be more "objective" since It Is supposedly larger. 
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Although carefu) comparative research usually intends to provid 
guarantees against stereotypes and other faulty generalizations, 
experimental research methods are perhaps more capable of identifying 
the faults in assumptions and ''accepted** proposition. Experimental 
research mat<es its greatest contribution when it goes beyond the 
rudimentary testing of hypotheses to allow for systematic review of 
the underlying assumptions on which the hypotheses are built. Consider 
ing the important advances in knowledge that can derive from well- 
executed experimental research, one may wonder at the relatively small 
percentage of cross-cultural studies of education that mal<e effective 
use of experimental procedures. There are good reasons: foremost 
is the fact that experimental studies (even in one*s own culture) are 
difficult in educational research, as in any other applied social 
science field. Experimental subjects in social research are dynamic 
creatures in complex environments, not experimental animals that can 
be submitted to highly controlled life conditions. 

The study is a complex experiment in human learning, discoverin 
a basis for accepting certain hypotheses and a laci< of evidence for 
others. But, perhaps most important, the study provides a basis for 
challenging some of the stereotypes about Latin Americans— the very 
stereotypes that had appeared earlier in the series of ethno- 
pedagoglcal studies as reasonable and respectable assumptions. 

Although the design is experimental, many of the findings 
are based on descriptive aspects of the study; the study not only 
tests hypotheses but also provides descriptive constructs about the 
interaction of learners in Sao Paulo with discovery and expository 
approaches to teaching and with the group and individjal modes of 
learning environments. Hypotheses were tested and judgments about 
them were derived from empirical data. That the findings are mixed 
within certain hypotheses was a clear warning that one or more basic 
assumptions were askew or that there were flaws in the conceptual 
basis underlying the hypotheses. Mixed findings from data in a 
carefully designed and executed experiment are just the sort of clue 
needed to seek out stowaway stereotypes. 
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The study experimentally modified an instructional experience 
in such a way as to make it more "culturally attuned" to the pedagogi- 
cal expectations and characteristic learning styles of semi-literate 
Sao Paulo residents with little or no formal education. The vehicle 
of 'the experiment was programmed instruction--wide1y used in experi- 
mental studies of instructional variables because it assures less 
random variability than teacher-led instruction. The relative 
effectiveness of group-mode learning was tested against individual- 
mode learning; an expository instructional presentation was tested 
against a discovery- learning approach. The hypotheses proposed that 
the subjects of this experiment would learn more effectively through 
a group-mode expository instructional experience. Assuming that 
Latin Americans, in general, are acculturated to learn in largely rote 
methods and assuming that they are more gregarious and communal - 
cooperative than independent-competitive, the experimental data 
should have consistently supported these hypotheses. But the findings 
were mixed: strong support for the hypotheses came from some cases, 
convincing evidence for refuting the hypotheses came from others. 
Clearly, something was wrong with the assumptions. 

The study had begun, innocently, with a stereotype. The 
contradictory findings forced a reconsideration of the assumptions 
and refutation of the stereotype. Although there is evidence that 
formal schooling had served to mat^e some of these Sao Paulo residents 
less able to learn effectively in discovery modes, the others- 
especial ly those less affected by formal education— learned effectively 
through discovery experiences. More important, discovery learning 
experiences provided for the relatively under-educated Brazilian 
sample, the same long-term advantage. In terms of continued effective 
use of new learnings that has been observed among highly educated 
North American samples. The findings do not support the view that 
Latin Americans are. In general, acculturated to be "rote learners." 

The study Is not intended as a promotion or advocacy of 
programmed instruction within non-formal education. In the research, 
programmed instruction serves as a vehicle for the experimental modes 
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of teaching; )n effect, it represents a carefully controlled teaclier's 
presentation. Tlie widespread use of programmed instruction may or 
may not be a good idea in Brazil; that question was not a major issue 
for this study. But it is important to note that in the context of 
this particular experience, at least, programmed instruction stood 
well the test of learning effectiveness. (This finding could be of 
some encouragement to Brazil's Ministry of Education and Culture, 
with special reference to their new PI -based program for out-of-school 
youth in Sao Paulo.) 

To some degree, schooling seems to be a culprit in the findings 
of this research. Group use of discovery-mode learning was found to be 
more effective with traditional learners; the less schooling subjects 
had had the more I lively the discovery mode was to lead to effective 
learning. Since effective learning was described as including the 
likelihood of use of the learning (as revealed in the delayed post- 
test) one might conclude chat schooling produced some sort of 
deleterious effect. But the cause-effect relationship is not 
established by this study. In fact, even if the possible inference 
were substantiated, one might still argue that the many desirable 
effects of school ing--even a rote-learning type schooling, outweigh 
the damage that it may do. It is important to recall Goodnow's 
African studies (in the Piaget tradition) that show that without 
schooling, learners rarely get out ol' the "concrete operations" stage. 
Certainly, then, the findings reported here would be misused as an 
argument against formal education. 

The Experiment in Sao Paulo ; 
Its Conceptual Base 

Educational technology is crossing cultures. Programmed 

instruction(PI) , for example— a teaching method which began to mal^a an 

impact on North American education in the late I950's— has rapidly 

spread beyond national boundaries. "The rapidity of its spread may 

well have made P.I. the most swiftly disseminated innovation in the 

history of education."*' Educational Journals have reported the use of 

PI in such diverse areas of the world as Western Europe, the Soviet 
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bloc, Israel, the Arab states, West and Central Africa, Asia, and South 
America. Spaulding,^ in an introduction to UNESCO's directory of PI 
activities in 65 countries, calls the international expression of 
interest In programmed instruction "explosive."^ Similarly, Stolurow 
comments that 

. . . while PI began in the United States, it is probably 
enjoying a more flourishing development in other countries 
at the present time. They seem to have tal<en the results 
of early wort< more seriously than has the United States 
and have moved more rapidly toward the institutionalization 
of instructional technology within their educational and 
training establ ishments.o 

The introduction of a teaching innovation—such as PI — into the 
education arena Is an international effort linking teachers, learners, 
and cultures. The educator brings his**6wn educational experiences 
and expectations to bear upon instructional tasks. In the process of 
implementing educational programs, he introduces innovations to 
learners In receiving cultures. The teaching methods thus introduced 
are components of the instructional system in which they have evolved. 
As such, the methods are usually attuned to their original milieu. 
They are likely to be less attuned to teachers and learners In a target 
culture. Adaptations of novel methods to the receiving culture will 
probably be necessary if effective learning is to occur. 

Ethnopedagogical Inquiries 

A series of investigations into the problem of attuning 
teaching to culture is being conducted by Ward and others. These 
Inquiries Into learning effectiveness are seeking to gather more 
precise information about culture-based variables in instructional 
systems which demand modifications of teaching procedures and 
transformations of instruct lonal' materials.^ 

This series of investigations falls within a conceptual frame- 
work which Burger has called "ethno-pedagogy."° The essence of ethno- 
pedagogical theory is that demonstrated cultural differences among 
learners demand attunements of teaching. Those cultural attunements 
of teaching which are likely to contribute to effective learning must 
be identified, implemented, and evaluated. Ethnopedagogical 
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investigations methodically gather data regarding learners in target 
cultures and the milieux in which these learners function. From these 
data, incongruities between cultures and teaching are identified, and 
suggested modifications in instructional systems are extrapolated. 
Hypothetical improvements in instruction are submitted to empirical 
testing to determine whether or not the suggested adaptations of 
teaching do indeed increase the effectiveness of learning within the 
target culture. 

A Brazilian Investigation 

A recent investigation in Brazil formed a link in the series of 
ethnopedagogical inquiries described above. ^ The research focused upon 
two dimensions of the problem of attuning PI to learners in a specific 
Brazi 1 Ian mi I leu: (I) the dimension of instructional interaction— 
whether or not group conditions (in contrast with individualized 
conditions) of instruction will facilitate learning through PI; and 
(2) the dimension of program style— whether or not the use of a 
discovery program style (in contrast with the more common expository 
program style) will facilitate learning through PI. 

In discussing the first of the above dimensions (the attune- 

ment of Instructional Interaction to cultures) Burger sees Individually 

prescribed instruction as possibly Inappropriate In non-Anglo cultures: 

We do not say that It [individually prescribed Instruction] 
is good or bad for Yankees, but merely that It does not 
necessarily fit the far more sociable patterns that are normal 

In non-Anglo cultures It Is Anglo culture that spins 

off the already asocial Yankee Into a lonely pupil sitting 
at an isolated carrel and talking to the lifeless computer. 
I find It entirely feasible that the same cybernetic system 
could be designed for more communal activity.'^ 

Kress concludes from six North American studies of social interaction 

and PI that "Individual pacing and privacy may not be essential for 

effective programmed learning ... the results . . . lead to 

speculations that social interaction may actually facilitate programmed 

learning."'' Summarizing research carried on In England, Amarla, 

Blran, and Lelth came to a less guarded conclusion: 
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... The notion of programmed learning as an exclusively 
Individual process may be abandoned. Cooperative work has 
been shown to be fully as effective as individual work and 
to take no longer. Whatever the additional benefits of 
social interaction may be, they need not be eschewed if 
programmed learning is adopted as a teaching method. 12 

It may well be that the **additional benefits of social interaction" in 
non-Anglo cultures are even greater than those already observed in the 
United States and England. At any rate, an investigation of the 
question of facilitating PI in non»Anglo cultures through group inter- 
action appeared to be warranted in the Brazilian research. 

In the area of concern defined by the second dimension of the 
research problem, expository versus discovery teaching, anthropologists 
and educators have noted varying cultural patterns. As early as I938, 

Fortes observed that the Tall ens i rarely ask questions looking for 
13 

reasons. They demonstrate much more curiosity about methods than 

about underlying principles. Hall considers the extent to which rote 

learning is used as an important educational variable among cultures.'^ 

Bruner recognizes that discovery methods of teaching take for granted 

"middle-class hidden curricula" through which children learn motivation 

toward subject matter expertise and thinking skills necessary to use 

1 5 

the mind in intellectual ways. ^ He admits that these assumptions 
about motivation and cognitive skills are questionable within certain 
American sub-cultures. Discovery teaching assumptions may be even 
more out of harmony with the "hidden curricula" of learners in cultures 
where expository methods are the teaching norm. An investigation of 
the relative effectiveness of cultural adaptations of PI in expository 
and discovery directions seemed to be both timely and relevant as a 
focus for the Brazilian investigation. 

Questions and Hypotheses 
A concern for attuning teaching (such as PI) to a culture (such 
as Brazil) along specific (individual i zed-group and expository- 
discovery) dimensions gave rise to a series of research questions: 
Does programmed instruction teach in a Brazilian milieu? Will the 
method be equally effective for all learners, or will characteristics 
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such as school success, modernity, and motivation affect the degree 
to which PI facilitates learning? What kinds of adaptations of PI 
increase the effectiveness of the method for Brazilian learners? 
Will learners achieve more studying alone, or in small groups? Will 
they achieve more through discovery methods or through expository 
methods? Are attunements of PI equally important to all learners, or 
will some learners benefit more than others from efforts to attune 
teaching to their culture? 

It was hypothesizes) that (1) learning occurs through PI in a 
Brazil Ian mil leu; (2) PI conditions differ (along individual ized-group 
and expository-discovery dimensions) in their relative effectiveness 
as facilitators of learning; (3) the school success of learners 
affects the degree to which PI (under all treatment conditions) 
facilitates learning} (4) the modernity of learners affects the 
degree to which PI (under all treatment conditions) facilitates 
learning; (5) motivation to learn affects the degree to which PI 
(under all treatment conditions) facilitates learning; (6) cultural 
attunements of PI are relatively more produ-itive for learners who 
have experienced less school success than for those who have experi- 
enced more school success; (7) cultural attunements of PI are 
relatively more productive for traditional learners than for modern 
learners; and (8) cultural attunements of PI are relatively more 
productive for less motivated learners than for more motivated 
learners. 

The first hypothesis , that learning occurs through programmed 

Instruction, had been overwhelmingly supported by previous research. 

Students do learn from PI: 

, . . They learn from linear programs, from branching 
programs built on the Skinner Ian model, from scrambled 
books of the Crowder type, from Pressey review tests with 
immediate knowledge of results, from programs on machines 
or programs in texts. Many kinds of students learn— 
college, high school, secondary, primary, preschool, adult, 
professional, skilled labor, clerical employees, military, 
deaf, retarded, imprisoned— every kind of student that 
programs have been tried on. Using programs, these students 
are able to learn mathematics and science at different levels. 
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foreign languages, English language correctness, the details 
of the U.S. Constitution, spelling, electronics, computer 
science, psychology, statistics, business skills, reading 
skills. Instrument flying rules, and many other subjects. 
The limits of the topics which can be studied efficiently 
by means of programs are not yet known. 16 

It seemed reasonable that learning through PI would also occur In a 
Brazilian milieu. Hypothesis 1 was to be tested to discover whether or 
not learning does Indeed take place. 

The second hypothesis , that treatment conditions differ along 
dimensions of cultural attunement In their relative effectiveness as 
facilitators of learning, grew out of ethnopedagoglcal theory. A 
basic assumption of ethnopedagogy Is that adjusting educational 
practice In the direction of cultural attunement will Increase learning. 

Students of culture have observed the group-oriented natur*" of Latin 
17 

societies. They have also observed the prevalence of guided, 
deductive, didactic teaching with Latin cultures.'^ Since the cultural 
variables under consideration. Individual ized-group Interaction and 
exjbosltory-dlscovery teaching styles, were also considered to be 
Important teaching variables, adjustments of programmed Instruction 
along such dimensions In the direction of cultural attunements were 
expected to facilitate learning. Hypothesis 2 was to be tested to 
determine whether or not such a phenomenon does Indeed occur. 

Hypothesis 3 suggested that the school success of students, 
operational I zed In terms of years of schooling and scores on an 
Intelligence measure, was expected to be related to learning outcomes. 
North American studies have shown high correlations between scores on 
I Q measures and achievement through Pl.'^ It seemed reasonable to 
suggest that similar relationships would be found In the Brazilian 
milieu. Hypothesis 3 was to be tested to determine to what degree 
such relationships exist. 

H ypothesis k stated that differences among learners within a 
culture on modernity variables such as type of schooling, social 
status, urbanity, attitudlnal modernity and media exposure were also 
expected to relate to effective learning through PI, Three lines of 
reasoning underglrded this prediction. The first was based on what 
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could be called a principle of learner similarity; when a teaching 
method developed In one culture Is introduced to another culture, It 
is most lil<ely to be effective with learners who have characteristics 
similar to those in the first culture, and least lil<ely to be 
effective with learners who differ from those in the first culture 
in some important way. If this premise Is correct, It would logically 
follow that PI, which has developed In a modern, technological milieu, 
would be most effective with learners In another milieu who are 
similar to learners for whom and with whom the method was developed 
(I.e., modern learners). 

The hypothesis that modernity Is related to the effectiveness 
of PI was 'tlso deduced through a second line of reasoning based on a 
principle of pedagogical familiarity: the degree to which the method 
employed fits the prevlr'.s experience and expectation patterns of the 
learner will influence the response of the learner to the teaching 
method. A method which includes familiar components should elicit a 
more favorable response than a method which contains novel components. 
The components of PI methodology are modern In their origin. Thus 
they seemed likely to be better received, at least Initially, by 
modern learners, for whom they were more familiar, than by tradi- 
tional learners, for whom the components of PI were less familiar. 

A third line of reasoning also led to the hypothesis that 

modern persons would learn more through PI than traditional person>j. 

When PI Is introduced Into a culture. It constitutes an Innovation, a 

new idea. Innovators and early adopters of innovations have shown 

higher scores on certain modernity measures than those who are slower 

20 

to adopt Innovations. It follows that modern (more Innovative) 
learners will accept a teaching innovation (PI) more readily than will 
traditional (less innovative) learners. Carrying this kind of logic 
another step, it seems reasonable to suggest that modern learners, 
who are more likely to accept PI, are also more likely to learn 
through the method than are those traditional learners who resist it. 
Hypothesis k was to be tested to explore relationships between the 
modernity of learners and the effectiveness of PI as a facilitator of 
learning. 



ERIC 



00147 



Hypothesis 5 suggested that motivation to learn (measured by 
age» sex, and community participation) would be related to effective 
learning through PI. Interest In the subject matter (nutrition) was 
expected to be greater on the part of women than of men, for the 
obvious reasons that women more often plan and prepare meals and ^re 
concerned for the health and well being of their husbands and children. 
Older people were expected to be more Interested In the subject matter 
than younger people for similar reasons Involving family responsibility 
and concern about personal health which tends to Increase with aging. 
Community participation on the part of learners was expected to relate 
to achievement through PI, particularly when, as Is the case In 
several Instances In the present research, PI takes place within a 
cohesive community structure. When a strong esprit cfe corps exists, 
the effectiveness of PI as a facilitator of learning should be 
enhanced. Hypothesis 5 was to explore the extent to which motivation 
to learn Is related to the effectiveness of learning through PI. 

The essence of Hypotheses 6, 7. and 8 was that the cultural 
attunement of PI Is more essential to learning for some learners than 
It Is for others. The hypotheses stated that cultural attunements of 
PI are relatively more productive for learners who have had less 
school success, who are less modern, and are less motivated to learn. 
Highly successful, modern and motivated learners learn In spite of 
materials and methods which are poorly attuned to their culture. 
Their ability. Interest, and exposure to modern ways help them to 
bridge the gap between the pedagogy and the culture. Less successful, 
less modern and less motivated learners cannot bridge the cultural 
gaps as well. Hence the cultural attunement of PI was expected to be 
relatively more productive for this latter group of learners than for 
the former. 

Design of the Research 
The design for the research called for a four-cell participant- 
observer demonstration with repeated measures and four replications. 
It can be represented symbol leal ly as follows: 
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0 Xdf 0 0 
0 Xag 0 0 
0 Xb, 0 0 
0 Xb^ 0 0 

where 0 represents pretesting, posttesting, and delayed posttesting, 
X represents treatments, £ and b, represent treatment conditions along 
a program style dimension, and land 2, represent treatment conditions 
along an instructional in'eraction dimension. The symbols a^ a2» bp 
b2 indicate combinations of conditions to be employed in trea'tments'Tn 
"sTl X 2 factorial design. Dotted lines separating treatments indicate 
that intact groups are involved. Treatments were to be replicated 
four times, so that a total of sixteen intact groups would be included 
in the study. 

Subjects 

The subjects in the study were 1^5 youths and adults who reside 
in the metropolitan area of Sao Paulo, Brazil. They were voluntary 
participants in a three-session course on nutrition given at sixteen 
testing sites throughout Greater Sao Paulo. Their ages ranged from \k 
to 75 years. Seventy percent were women. Only 15 percent studied 
beyond primary school. At least half reported very traditional 
school experiences (such as standing for recitations). Eighty-three 
percent were employed in manual occupations or are from homes where 
the chief breadwinner is employed in a manual occupation. Three** 
fourths of the subjects resided in urban centers of 10,000 or more 
when they were ten years old. Fifty-five percent lived in states 
other than Sao Paulo. Forty-two percent of the subjects migrated to 
Sao Paulo within the last nine years. Seventy-two percent attended 
church at least once a weel<. 
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Test Sites 

The sUteen test sites at which research was conducted were In 
Sao Paulo. Eight were In the south zone of the city, four were In 
the west, three were In the north, and one was In the east. Twelve of 
the groups were church-related, and four were In a state-sponsored 
literacy school. Of the church-related groups, half were intact, on- 
going women's organizations which were accustomed to meeting 
regularly, and half were &d hoc groups created with volunteers 
enlisted through publicity in the local community. An attempt was 
made, within the context of existing linkages, to select groups which 
were as diverse as possible from each other in terms of geographical 
area of the city, SES, religious affiliation, and motives for partici- 
pation in the course. 

Initial arrangements at test sites depended heavily upon good 

human relations and the credibility of the investigator with persons 

contacted. Key persons at each site needed to become sufficiently 

convinced of the value of the project to become active recruiters of 

2 1 

students for the cursinho. These persons were then trained to 
serve as coordinators of local arrangements. Often the Investigator 
or a teacher was asked to attend community meetings to present and 
publicize plans for the cursinho. Follow-up contacts were usually 
necessary to verify that arrangements had been made. An average of 
five contacts by the Investigator or by a teacher was necessary at 
each of the sixteen sites to complete these initial arrangements. 

Teacher-Assistants 

The obtrusive effect of a foreign investigator's presence at 
test sites was lessened by the leadership of national teachers. Find- 
ings were enriched by the contributions, Insights, and awareness of 
cultural nuances of these competent national persons. Their enlighten- 
ment of the Investigator throughout the planning, execution and 
evaluation s s of the research was a significant part of the 
Investigate process. 
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The three teacher-assistants participating in this research 
were students at the Faculdade Teologica Batista de Sao Paulo. They 
had been recommended by faculty members at their institution as being 
persons qualified for a research-assistant role. Each was in the 
fourth year of university-level worl<. Two were men and one was a 
woman. Two were education majors; the third had completed three 
courses in education. Two had had course worl< in the scientific 
method and probability theory. All were experienced teachers of adult 
In non-formal settings. 

These teacher-assistants received both financial remuneration 
and course credit in return for their participation In classroom 
training sessions and data gathering activities at test sites. 

Teacher-assistants were trained through weekly three-hour 
training sessions, beginning five weeks before the first data were 
gathered, and continuing to the end of field work. Activities during 
these sessions included: (1) discussion of relevant research, educa- 
tional, and sociological theory; (2) a detailed study of the design 
of the research In which they were participating (including the 
research problem, hypotheses, assumptions, variables, instruments, 
procedures, and analyses of data); (3) practice In Interviewing, • 
administering tests, and other data gathering procedures; (4) coordlna 
tion of schedules and arrangements being made at test sites; 
(5) evaluation of field work at test sites; (6) discussion of pre- 
liminary findings and their Implications; and (7) discussion of 
research problems and decisions. 

Assignment of teachers to test sites was made In such a way 
that all teachers participated equally In all treatment conditions. 
Such assignment was randomized as far as was practicable. 

At least one teacher-assistant and the Investigator shared 
data gathering activities at each test site. These activities 
Included distributing and collecting materials, giving Initial 
Instructions In using PI, leading students from one activity to 
another, giving oral pretests and posttests, and Interviewing. The 
presence of the Investigator at all test sites enabled certain 
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teacher-generated errors and fluctuations in procedures to be observed 
and corrected, and provided an on-the-job extension of classroom 
training. 

Programmed Instruction Unit 

Two programmed versions of a basic nutrition unlt^^ were varied 
systematically along three dimensions of expository-discovery teaching 
described by Shu I man? (I) the degree of guidance provided, (2) the 
ruleg or egruie sequencing of Instruction, and (3) the didactic ot 
Socratic style of Instruction.^^ 

Degree of Guidance .— In the expository condition, the learners' 
behavior was more controlled, and convergent responses were reinforced. 
In the discovery condition, the student was given more freedom. 
Divergent responses were encouraged. 

Sequence of Instruction .— The expository program was more often 
ruieg, proceeding deductively from rules to examples. The discovery 
program was more often egrule; the student wa^> given examples and 
encouraged to find the rules himself. 

Didactic-Socratic Dimension . --In the discovery program, a 
Socratic teaching style created successive states of equilibrium and 
disequilibrium as problems were raised, tensions created, solutions 
formed, out of which new problems are raised. This style was con- 
trasted with didactic teaching In which the student makes smooth 
progress through carefully planned, small Instructional steps. 

At the same time the programs were being varied along the 
above dimensions, an attempt was made to control and equate (I) the 
content, (2) the meanlngfulness, and (3) the reading difficulty of 
the two versions. 

The content was controlled on all dimensions except the 
thinking or cognitive behaviors required of the students (the latter 
vary systematically as the teaching styles are varied). The same 
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instructional objectives, facts, concepts, principles, and illustra- 
tions were used in both versions of the program. 

Equal meaningfulness was sbught for both versions of the unit. 
Teaching methods which encouraged rote learning were avoided. Every 
effort was made to contrast meaningful expository teaching with 
meaningful discovery teaching. 

Equivalence of reading difficulty between the tv/o versions of 

the unit was estimated by an analysis of 100-word passages selected 

from the beginning, middle, and end of each programmed lesson. The 

average number of sentences per 100 words was 12.5 for the expository 

version and 12.8 for the discovery version. The overall frequency of 
2k 

unfamiliar words was 1.6 per 100 words in the expository unit, and 
2.5 per hundred words in the discovery unit. Since Portuguese reading 
difficulty scales were not available, absolute grade levels or dif- 
ficulty levels could not be determined from these data. On an English- 
25 

language scale the reading level of the expository program was 
second grade, first month, and for the discovery program second grade, 

second month. On a Spanish reading difficulty scale developed by 

26 ' 

Spaulding, the expository unit had an overall score of and the 

discovery unit an overall score of 51. Readings falling between 40 

and 60 on the Spaulding scale are considered "very easy, offering 

27 

maximum comprehension for the new reader." 

Procedures in Writing . —The following methodology was developed 

for writing the expository and discovery versions of the nutrition 

28 

unit: (1) using a Gagne-type tasl< analysis, behavioral objectives 
were determined for the unit, and for each lesson within the unit*, 
(2) from these objectives, the basic concepts and principles to be 
taught were derived} (3) a rough draft of a "free-style" program was 
developed, representing a direct route to the objectives by way of PI, 
and giving little attention to the expository or discovery nature of 
the sequences. (The emphasis here was on capturing a natural teaching 
style. The stylistic components of instruction tend to become stilted 
In attempts to write on the two extremes); {k) two non-programmed 
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lesson plans were outlined as models of expository and discovery 
teaching. The question at this point was, **How would an experienced 
teacher reach these goals via the two methods?**; (5) using the 
expository lesson plan in [k] as bas6, the free-style program was 
adjusted in an expository direction [since PI units developed from 
task analyses tend to be quite expository in nature, the adjustment 
in this direction was minimal]; (6) the teaching methods from the 
discovery lesson plan [k^ above] were used to adjust the program in 
a discovery direction; (7) a systematic analysis of the two versions 
of the program was made (a) to determine whether or not the teaching 
methods In the two versions did indeed differ in their degrees of 
guidance, ruieg or egrule sequencing, and didactic or Socratlc style, 
and (b) to determine whether or not the same instructional objectives, 
principles, concepts, facts, and illustrations were included In both 
programs. The two versions of the unit were cross-referenced frame 
by frame so that subtle similarities and differences between them 
could be compared and controlled. This cross-referencing method of ^ 
comparison enabled rather precise assessments of the content included 
and the pedagogy employed in each version of the unit. 

Cooperation in Writing .— Cooperation was sought In writing the 
PI unit to verify the accuracy of the nutrition Information offered, 
and to assist in attunements of the materials to the language and 
cultv.re of the target group. To establish the accuracy of the nutri- 
tion information In the unit, standard current nutrition texts and a 
professional nutritionist were consulted. A Brazilian professor of 
adult education helped to maximize the linguistic and cultural 
attunement of the materials. 

Individual Testing .— During the Individual phase of the testing 
of materials, each programmed lesson was taught to three or four 
different informants, one at a time. In a private, across-the-table 
setting. The informants read frames aloud and made overt responses. 
Insights into the thinking processes of the students were provided 
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through verbal and non-verbal behavioral cues. The investigator 
augmented the information she gleaned by asl<ing probing questions 
(such as, "What are you thinl<ing?") . She made on-the-spot improvements 
in the program while the student was responding by adding written 
prompts to the frames, or breaking down the instruction into smaller 
steps. Observations and impressions were both hand and tape recorded. 
The resulting information furnished the basis for the first revision 
of the lessons. 

Group Testing . "-The revised lessons were tested a second time 
under group conditions which simulated as closely as possible the 
actual field setting in which they were to be used. Groups of four 
or five students worked alone or in teams, completing the lessons 
without teacher help. An item analysis of each student's response to 
each frame supplied the basis for the final revision of the PI 
lessons. 

Production .— The final version of the programmed unit was 

mimeographed, one frame to a page. Large type, ample spacing, and a 

careful layout of frames were employed to maximize readability. Each 

lesson was collated as a separate booklet. The format and appearance 

of the expository and discovery versions of the lessons were identical 

29 

except for the color of the covers. 
Instruments 

Quest ionna i res . --Three questionnaires were used in the research. 
Questionnaire A was designed to gather data on certain demographic, 
sociological, and personal characteristics of learners. It was 
administered orally and individually during the second treatment 
session by the investigator or a teacher-assistant. Some of the items 
in Questionnaire A had been used In previous Investigations In a 
Brazilian milieu by Herzog'' and Kahl.' Other Items were developed 
specifically for the present research. Prom responses to items in 
this questionnaire, Information was provided concerning each subject's 
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sex, age, years of schooling, type of school experience (along a 

traditional -modern dimension), occupation, previous residence (when 

ten years old), length of present residence in Sao Paulo, and degree 

of community participation (church attendance). 

Questionnaire 6 attempted to measure individual modernity, or 

a composite of attitudes, beliefs, and behaviors characteristic of 

persons in highly urbanized, industrialized, and literate societies. 

After considerable deliberation, an adaptation'' of the Smith-lnkeles 

Minimum Scale of Individual Modernity, Short Forms 5 and 6 was selected 

as a modernity measure In the present research. "^"^ The primary reason 

for the choice was the broad application and good validation of the 
36 

instrument. 

Questionnaire C was administered during the last treatment 
session. Five items explored the student's history of exposure to 
nutrition information from other sources (radio, television, literature, 
conversations, other meetings) during the time period of the study. 
Two items Inquired into the means of transportation to the class 
sessions, and the length of travel time required. One item explored 
the possibility of previous exposure to programmed instruction 
methodology on the part of the student. The last item, a dependent 
variably. measure, asked the student If he worked alone or with other 
persons on home assignments. 

Otis Mental Ability Test (Beta Level, Short Form) .--A score on 

a group Intel 1 Igence test was one of the literacy-related measures used 

In this research. 

The Otis test utilized Is an equivalent form of (the 
Northamerlcan Beta level test). The test was validated by 
the criterion of school success, and (shows) a high correla- 
tion with other tests of general intelligence. It was 
chosen (for the present research) because of (facility of) 
application (In group settings) and facility of manual 
correction. In Brazil, various forms of the test have beei 
used In educational ... and industrial sectors. 37 

Although the Otis instrument Is less precise than most of the complex 

and individually administered tests. It affords a "satisfactory rough 
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classification . . . (which) can be used with advantage ... to 
segregate pupiis into relatively homogeneous groups for . . . research 
purposes."^ For subjects in the present research, the correlation of 
the Otis test with years of schooling was .55» correlations with 
measures of content acquisition, transfer of training and retention 
of learning were in the .i(00 range. 

Exercise I ."-Exercise I was a criterion measure based on the 
instructional objectives of Lesson I in the nutrition unit. The 
exercise included eight sentences, each of which is completed with 
the food group to which a given food belongs. Two examples of 
sentences from this exercise are: "Chicl^en belongs to the group of 
foods which bui Id ." "Pudding belongs to the group of foods with mMk,." 

Exercise 2 .— 'This exercise was also a criterion measure. It 
was based on the instructional objectives of Lesson 2 of the nutrition 
unit. Students were asl^ed to supply correct numbers in the following 
sentence: 

"Every day, 

adults need to eat: 

foods with mWk t imes; 

foods that build t imes; 

foods that protect ^times} 

foods that give energy t imes." 

Planejando Uma Dieta: Written Pretest-Posttest-Delaved 

Posttest .— This problem-solving tasl<. Planning A Diet, was a repeated 

measure. Students were given a sheet of paper on which is printed 

a list of 38 foods and the following instructions: 

Here is a list of foods. If you want to have an adequate 
diet, what foods will you eat tomorrow? You may mal<e 13 
choices from these foods. Write them one by one in the 
b)&t)k spaces in the order (you choose them). 39 , Remember 
that you want good nutrifJon. Don't rush. Plan you diet 
welt. When you finisi,. !al<e your I ist to the teacher. ^0 
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Oral Pretest-Ppsttest-Oelayed Posttest . "■Immediately after 
planning his diet (above) the student was asl<ed to give reasons for one 
of his choices. He is questioned in a private setting. The inter- 
viewer first selected a frequently-chosen food which appeared on the 
interviewee's list. The interviewer then recorded (in writing) the 
interviewee's responses to three questions: 

"Can you show me where you wrote (food), please, so that I 
can checl< your choice on this paper?" 

"Why did you choose (food)?" 

"Are there other reasons why you chose (food)?" 

Attendance Form .— A form was provided for marl<ing the student's 
presence at sessions, or giving reasons for his absence. 

Instrument for Choosing PI or a Story Method . --Pur Ing the fast 

treatment session, the student was given a choice between PI and a 

story. In a private interview setting, the student was shown two 

bool<lets with identical covers, formats, color, and size. The 

interviewer said. 

We would I il<e to give you a copy of Lesson k so that you can 
teach a friend. You may choose between two styles. One is 
programmed instruction, just lil<e you studied in this course. 
The other says the same things, but is written I il<e a story. 
Both of the bool<s have the same teachings. The only 
difference is that one is a story (shows bool<) and the other 
is programmed instruction (shows book) lil<e you Just 
finished studying. Which of the two would you thinl< It 
best to tal<e, the programmed instruction or the story?''^ 

The student 's choice of a teaching method was recorded. 
Data Gathering 

Data were gathered through three visits to each of the sixteen 
test sites. During the first session, the students were given written 
and oral pretests, instructions for using programmed texts. Lesson 1 
(a PI booklet). Exercise I (a criterion measure), and Lesson 2 for 
homework. During the second session, the students completed Exercise 2 
(criterion measure), Lesson 3> and written and oral posttests. They 
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were given Lesson k for homework. Data on demographic and personal 
characteristics of the students were also gathered during the second 
session (through Questionnaires A and 6). During the third session, 
students were given written and oral retention tests (delayed post- 
tests), an opportunity to choose between a programmed text and a 
lesson In story form, a post-treatment questionnaire (Questionnaire C) , 
and an intelligence measure (Otis, Short Form, Beta Level). Certifi- 
cates for completion of the course were distributed. 

Variables 

Cronbach, Shulman, ^ and others have suggested that 
research on teaching should provide for repeated and multiple measures 
whenever possible, so that learning strategies, affective responses, 
and longer term effects of teaching can be observed alongside the more 
usual measures of Immediate learnings and content acquisition. 

In keeping with these methodological suggestions, the present 
investigation considered a variety of learner characteristics 
(independent variables) and learning outcomes (dependent variables). 
Table 1 summarizes independent, dependent,. and treatment variables 
considered In the research. Independent variables included school 
success, modernity, and motivation. Dependent variables included 
content acquisition, transfer of training, retention of learning, 
strategies employed In learning, and affective responses to instruction. 
Treatment variables included Individual 1 zed-group and expository- 
discovery dimensions of programmed instruction (PI). 

Tables 2, 3> and k provide more detailed descriptions of 
measures of independent variables employed In the research. Measures 
of school success (IQ Score and Years of Schooling) are described in 
Table 2. Measures of modernity (Kind of Schooling, Urbanity of 
Previous Residence, Region of Previous Residence, Stability of 
Residence In Sao Paulo, Occupational Status, Attltudlnal Modernity, 
and Media Exposure) are described In Table 3* Measures of motivation 
(Sex, Age, and Community Participation) are described In Table k. 
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Tables 5> 6, and 7 provide detailed descriptions of measures of 
dependent variables employed In the research. Table 5 describes 
measures of acquisition of content, transfer of training and retention 
of learning (Exercise 1, Exercise 2, Balance of Diet, Variety of Diet, 
and Unprompted Recall). Table 6 describes measures of strategies 
employed In completing programmed Instruction units (Accuracy of 
Responses, Copying Feedback, StabI 1 Ity of Responses, and Time 
Required) and In the pretest-posttest-delayed posttest ("pop" Choices, 
Shifting Focus, HI-HI-LO-LO Pattern, l-a/S-'* Pattern, Wild Choices and 
Added Course Reasons). Table 7 describes measures of affective 
responses to Instruction (Pleasure Reasons for Food Choices, Choosing 
PI Instead of a Story, Conversations about Course, Completeness of 
Programmed Lessons, Working Alone or with Others, and Attendance at 
Sessions). 

Treatment variables In the research Included (1) an expository 
or discovery style of PI and (2) an Ind Ivldual Ized or group condition 
of Instructional Interaction In PI. The treatments were combined In a 
2x2 factorial design as follows: 

Ind Grp 



Exp 



DIs 



Where Jnd, represents the Individualized treatment, Grp represents the 
group treatment, Ex£ the expository treatment, DIs the discovery 
treatment, and Individual cases (sixteen Intact groups) randomly 
assigned to one of four treatment conditions. 
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In the Ind-Exp cell, an expository (more guided, more deductive, 
more didactic) programmed unit was used. Students studied alone. In 
Grp- Exp cell, the expository programmed unit described above was 
also used, but the instructional interaction was multilateral, with 
members of the group interacting both with the program and among each 
other. In the Ind-Dis eel I . the discovery (less guided, more 
inductive, more Socratic) programmed unit was combined with indi- 
vidualized Interaction. In the Grp- Dis cell, the discovery program 
was combined with multilateral interaction involving both student- 
student and student-program relationships. 

Analyses of Data « 

Analysis of variance was the primary statistical technique 
employed In the research. Simple and partial correlations were also 
used to study relationships between independent and dependent variables. 

Intact groups at geographically separated testing sites were 
the unit of analysis. Analyses of variance were based upon sixteen 
cases (intact groups) distributed equally or unequally 

(3*5,5,3) in four-cell designs. The small number of cases was 
problematic, reducing the likelihood of statistically significant 
findings. Since considerable interaction among subjects took place 
at each testing site, such a risk was an unavoidable alternative to 
serious violations of assumptions of independence of variances 
inherent In less conservative procedures. 

To test Hypothesis I— that learning occurs through PI in a 
Brazilian ml I leu— analyses of variance of the means of selected 
pretest and posttest measures were examined. 

To test Hypothesis 2--that PI treatment conditions differ 
(along dimensions of cultural attunement) In their relative effective- 
ness as facilitators of learnlng--analyses of variance were performed 
on all dependent variable measures In a two-way factorial design with 
individual ized-group treatments on one dimension, and expository- 
discovery program style on a second dimension. 



ERIC 




]5k 

To test Hypotheses 3* ^* and S^'that the school success, 
modernity, and motivation of learners affect the degree to which PI 
(under all treatment conditions) faci 1 itates learning-"simple and 
partial correlations among independent and dependent variables were 
ascertained* 

To test Hypotheses 6, 7» and 8— that cultural attunements of 
PI are relatively more productive for learners who are less successful » 
less modern, and less motivated —two-way analyses of variance were 
computed for all dependent variables with levels of cultural attune- 
ment (expository-discovery or individual ized-group treatments) on one 
dimension, and levels of school success, modernity, and motivation (as 
measured through selected independent variables) on a second dimension. 

Findings 

More than 1500 statistical analyses were performed on data 
related to this research. Clearly a decision had to be made either 
to delimit the study or to report findings hoi istical ly. Since the 
design of this research was theoretically cohesive and the variables 
and measures employed were mutually ancillary, a decision was made to 
report findings hoi Istical ly. Significant findings and recurring 
trends were collated and combined Into generalized observations. Such 
an emphasis on breadth and scope was considered consistent with the 
exploratory nature of the research. Significance of findings was 
reported at the .05 level of probability. To avoid loss of potentially 
useful information, trends were also reported when they were con- 
sistent with theory, highly applicable to teaching, Indicated useful 
directions for future research, and had an alpha level of at least .25. 

Research findings are summarized in Tables 8 through 19* A 
summary of findings related to Hypothesis 1— that learning occurs 
through PI in a Brazilian milieu— Is shown In Table 8. Analyses of 
selected measures supported the hypothesis. Such findings harmonized 
with Schram's conclusion (based on early Investigations of PI) that 
many t<inds of students learn many l<inds of subject matter through 
many kinds of programmed Instruction. The present research extended 
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the genera) izabi) ity of earlier findings to another subject area 
(nutrition) and to other students (adults in Brazil). 

A summary of findings related to Hypothesis 2a- 'that the 
group interaction condition (more culturally attuned) is more 
effective than the individualized interaction condition (less 
culturally attuned) — is shown in Table 9. The hypothesis was not 
supported. The findings were contradictory, and not statistically 
significant. 

A probable explanation for the paucity of significant findings 
related to this hypothesis is that the contrast between the indi- 
vidualized and group treatment conditions was not sharp enough. 
Students were strongly urged to work alone in the individualized 
treatment, and to work together in the group treatment. However— in 
order to create a natural teaching environment (as well as to maximize 
participant observation within the constraints of treatments) — 
students were given considerable freedom to interact in natural ways. 
The result was a tendency (possibly growing out of formal school 
experiences) to prefer working alone in both treatments. Thus, even 
though students in the group treatment worked together relatively more 
than students in the individualized treatment, the "individualized" 
and "group" treatments actually compared varying degrees of individual- 
ized instruction rather than clearly contrasted individualized or 
group conditions of instruction. 

Another possible reason for sparse findings related to the above 
hypothesis is that the treatment effects were overwhelmed by inter- 
actions with characteristics of learners, such as modernity and moti- 
vation. Findings related to other hypotheses considered in this 
research (especially Hypotheses 7a and 8a) would admit such an 
explan.-ition. 

A summary of findings related to Hypothesis 2b— that the 
expository program condition (more culturally attuned) is more 
effective than the discovery program condition (less culturally 
attuned) — is shown in Table 10. Significant findings on measures of 
acquisition of content (Exercises 1 and 2) and strategies employed in 
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learning (accuracy and completeness of prograinined lessons, and time 
required to complete lessons) supported the hypothesis. 

These significant findings become less convincing when inter- 
preted in the light of trends and Interactions which tended to support 
an alternate hypothesis that the discovery program condition Is more 
effective. Analyses of several measures (Balance of Diet, HI-HI-LO-LO 
Pattern, and Added Course Reasons) revealed interactions In which 
students In the discovery treatment showed learning gains one weel< 
after Instruction, while students In the expository treatment showed no 
learning gains during this period of time. Findings from analyses 
performed on other measures (Copying Feedbacl< and Choosing PI Instead 
of a Story) seemed to indicate that students In the discovery treat- 
ment were thinking more and were enjoying the Instruction more. 

Mixed findings lead to speculation that, while initial achieve- 
ment may be greater In the expository treatment, more thlnl<ing and 
more permanent learning may occur in the discovery treatment. Pre- 
vious research reviewed by Whlttrocl<,'*^ Tanner,^® and Hermann^' would 
support such a conclusion. 

A summary of findings related to Hypothesis 3— that the school 
success of learners affects the degree to which PI (under all treat- 
ment conditions) facilitates learning— is shown in Table 11. The 
hypothesis, was supported. The only exceptions to otherwise consistent 
findings were negative correlations between school success and (1) 
ability to plan a varied diet, (2) a tendency to choose PI Instead of 
a story, and (3) a tendency to work alone rather than with others. 
Possible explanations for these inconsistencies are not difficult to 
surmise. Learners with greater school success could have planned less 
varied diets because they are better integrated into a traditional 
system of schooling which rewards convergent, repeated behaviors, 
rather than the divergent, flexible behaviors required in varying food 
choices on repeated tests. Learners with greater school success could 
have chosen a story rather than PI because they had already mastered 
the programmed lessons (or perhaps were bored with the lessons, finding 
them too easy). Learners with greater school success could have 
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preferred working alone because "hey were more competent and confident. 
They did not need help from others, and became impatient with slower 
learners. 

A summary of findings related to Hypothesis that the 
modernity of learners affects the degree to which PI (under all treat- 
ment conditions) facilitates learnings-is shown In Table 12. The 
hypothesis was partially supported. The evidence was scattered, and 
not always in the direction hypothesized. 

Possible explanations for sparse and mixed findings are: 
(1) that the population considered in the study (semi -schooled youths 
and adults residing In Sao Paulo) was relatively homogeneous on 
modernity variables so that differential effects were too small to be 
observed; (2) that modernity variables are relatively independent 
factors which may be expected to relate to each other and to dependent 
variables in different ways in differing settings; (3) that modernity 
variables interact with expository-discovery and Individual I zed-group 
treatments (findings related to Hypothesis 7 would admit such an 
explanation); {k) that more modern learners show symptoms of waning 
Interest and mot Ivat Ion earl ler than their more traditional counter- 
parts (more Inconsistencies were observed on the last lessons and 
delayed posttests); (5) that attitudlnal ly modern learners are more 
sophisticated than traditional learners In their perceptions of course 
expectations, deciding, for example, to drop pretest reasons for food 
choices (which have a folkloric quality about them) in favor of 
course-based (more Intellectual) reasons for choices; and (6) that on 

at least one measure (kind of school experience) factors other than 

52 

modernity were being measured. 

A summary of findings related to Hypothesis 5— that motivation 
to learn affects the degree to which PI (under all treatment conditions) 
facilitates learning— Is shown In Table 13. The hypothesis had 
limited but consistent support on measures of female sex and community 
participation. Mixed and inconclusive findings failed to support the 
hypothesis on measures of age. 
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The daU partially supported Hypothesis 5*"*that motivation to 
learn affects the degree to which PI (under all treatment conditions) 
facilitates learning—on measures of sex and community participation. 
Hixed and Inconclusive flrui«n(^s failed to support the hypothesis on a 
measure of age. Younger learners appeared to be faster and more 
efficient than older learners (showing greater learning gains on 
measures of accuracy and stability of responses to programmed Items, 
time required to complete programmed lessons, shifts in focus, and 
unplanned, HI-HI-LO-LO Pattern responses). On the other hand, older 
learners appeared to achieve more on oral measures of information and 
cognitive gains (unprompted recall of course Information, and a 
tendency to add course*based reasons for food choices to earlier 
reasons given). These findings may indicate that older learners (when 
compared with younger learners) have developed greater skills In 
taking oral tests (perhaps through greater exposure to traditional 
kinds of school experiences in which oral recitations and examinations 
are practiced). The findings could also Indicate that, since oral 
measures are less dependent upon literacy skills than are written 
measures, older learners, who tend to have more difficulty In reading 
and writing, have a better opportunity to demonstrate what they have 
learned orally than In writing. 

A summary of findings related to Hypothesis Sa- 'that the group 
Interaction condition (more culturally attuned) is relatively more 
productive for learners with less school success than for those with 
more school success— Is shown In Table ]k. The hypothesis was only 
partially supported. The evidence was contradictory and inconclusive, 
possibly because not all of the learning which occurs In groups Is 
desirable learning! Less Successful learners— when compared with more 
successful learners— showed a greater tendency to learn desirable 
behaviors through the group treatment (such as planning a balanced 
diet, making thoughtful choices of foods, and doing accurate and 
complete work on programmed lessons). On the other hand, these less 
successful learners were also relatively more prone to learn 
undesirable behaviors through the group treatment (such as copying 
feedback and shifting focus of attention). 



00166 



)59 



A summary of findings relative to Hypothes I s 6b" -that the 
expository program condition (more productive for learners with less 
school success than for those with more school success-- Is shown In 
Table 15* The hypothesis was not supported. The findings were mixed 
and somewhat contradictory. The expository method was relatively more 
productive for learners with less school success than for those with 
more school success on several measures of learning (completeness and 
accuracy of programmed lessons, working with others, and choosing 
popular foods). At the same time, on other measures of learning 
(Stfbllity of Responses, Copying Feedback, Unprompted Recall, Added 
Course Reasons) more thinking appears to be going on among less 
successful learners In the discovery method. Here again, as in earlier 
findings related to Hypothesis 2b, a pattern emerges which suggests 
that, at least when thoughtful behaviors are criteria for learning, 
discovery teaching may be more effective than expository teaching. 
Students who have been less successful in coping with traditional 
schooling appear to achieve relatively more through the discovery 
method on measures of thinking. 

A summary of findings related to Hypothesis 7a- -that the 
group interaction condition (more culturally attuned) Is relatively 
more productive for traditional learners than for modern learners^-ls 
shown in Table 16. The hypothesis was supported. The fact that all 
significant findings and trends were in a single direction (the 
direction hypothesized) lends credence to an earlier suggestion that 
individual Ized-group treatments Interact with characteristics of 
learners (In this case, with modernity). 

A summary of findings related to Hypothesis 7b -that the 
expository program condition (more culturally attuned) Is relatively 
more productive for traditional learners than for modern learners-^ls 
shown In Table t7< The hypothesis was not supported. Scattered but 
conslstcrf evidence supported the alternate hypothesis. 

A possible explanation for these unexpected findings is that 
more modern learners (who are better able to cope with the expectations 
of formal education) have successfully learned to learn through 
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expository methods. They employ •'meaningful reception learning"'^ In 
Integrating new Information Into existing cognitive structures. 
Because of their success In learning through expository methods, they 
have little desire for change. Discovery teaching, with Its many novel 
features. Is perceived as a threat. On the other hand, less modern 
learners (who are less able to cope with the expectations of formal 
schooling) have been less successful In handling expository teaching 
methods; they resort to Ineffective, rote strategies of learning. 
Discovery methods force these less modern learners to develop new 
(more thoughtful, and hence more effective) strategies. Thus less 
modern 1earners--when compared with more modern 1earners--f Ind the 
discovery method relatively more productive. 

A summary of findings related to Hypothesis 8a" "that the group 
interaction condition (more cultural 1y attuned) Is relatively more 
productive for less motivated learners than for more motivated 
learners— Is shown In Table 18. The hypothesis was not supported. 
Instead, the alternate hypothesis— that the Individualized treatment 
is relatively more productive for less motivated 1earners--was supported 
on several measures. 

Once again, as In data related to Hypothesis 7a, the findings 
provide evidence that Individual tzed-group treatments Interact with 
characteristics of learners, making certain conditions of Instruc 
tlonal Interaction more effective for some learners than for others. 

The direction of the above findings— pointing toward relatively 
greater productivity of the Individualized treatment with less 
motivated learners-- Is probably related to the particular measure of 
motivation employed In the analyses (community participation) rather 
than to a larger "motivation" construct. Logically, persons who are 
more active participants In a community activity would tend to 
develop greater skills In working with groups than would learners who 
are less active participants. 

A summary of findings related to Hypothesis 8b- -that the 
expository program condition (more cultural 1y attuned) Is relatively 
more productive for less motivated learners than for more motivated 
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learners—is shown in Table 1$. The hypothesis was partially supported, 
with some of the evidence supporting the alternate hypothesis. From 
the findings a profile emerged of less motivated learners who are 
frustrated, anxious, and uncomfortable in the discovery treatment 
(maldng relatively more mistakes on programmed lessons, feeling ^ 
relatively more pressure from competition with peers and liiiitations 
on time, responding less favorably to the method than to a story 
method, and preferring to work alone). At the same time, these less 
motivated learners— when compared with their mre motivated counter- 
parts—are apparently thinking more and achieving more through the 
discovery method (gaining relatively higher scores on measures of 
balance and variety in planning a diet, giving relatively more stable 
answers to programmed items when time and peer pressures were removed 
[at home], copying relatively less feedback, showing relatively less 
tendency to shift focus of attention among food groups, and showing 
relatively less tendency to make thoughtless [wild] choices of foods). 

The above findings are quite similar to those related to other 
hypotheses in which expository and discovery treatments were compared 
(Hypotheses 2b, 6b, and 7b). The discovery treatment --when compared 
with the expository treatment— appears to be relatively more productive 
for less schooled, less modern, and less motivated learners on 
measures of thoughtful behaviors and relatively permanent learning 
gains. 

Conclusions 

At least six conclusions may be drawn from the findings 
reported in the research: 

I. PI provider a promising tool for development education. 
Subjects in the research adapted quickly to PI under all treatment 
conditions. The method was effective in teaching elementary principles 
of nutrition in adult basic education programs In Brazil. Over- 
whelming evidence that PI teaches (from both the present investigation 
and earlier investigations) leaves little room for doubt that similar 
efforts with similar students in similar cultures will meet with equal 
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success. The fear that programmed instruction— a method developed In 
North Amerlca--may be Ineffective In other milieux seems to be poorly 
founded . 

2. While adaptations of PI in the direction of group methods 
are not contraindicated by findings from the present research * such 
adaptations are not equally beneficial^ for all learners. Adaptations 
of PI in the direction of group methods appear to be relatively more 
productive for less modern and more motivated learners than for more 
modern and less motivated learners. A comparison of negative and 
inconclusive findings related to Hypotheses 2a (that the group Inter- 
action condition is more effective than the individualized condition) 
with quite consistent findings related to Hypotheses 7a and 8a (that 
the group interaction condition is relatively more productive for 
less modern and less motivated learners) supports such a conclusion. 

3. Adaptations of PI in the direction of discovery methods 
appear to be beneficial. Although initial learning appears to be 
greater in the expository condition of PI, more thinking and more 
permanent learning seem to occur in the discovery condition. Findings 
related to hypotheses comparing expository and discovery treatments 

^^2b* ^6b' ^7b' ^3b^ support such a conclusion. 

Highly successful, highly motivated learners achieve more 
through PI than less successful, less mtivated learners, irrespective 
of cultural adaptations of the method. Findings related to Hypotheses 
3 and 5 supported conclusions that school success and motivation are 
related to achievement through PI. Contradictory and Inconclusive 
findings failed to support Hypotheses 6 and 8, that cultural attune- 
ments of PI are relatively more productive for less successful, less 
motivated learners, than for more successful, more motivated learners. 
A comparison of the pos 1 1 1 ve findings related to H^ and H^ with the 
negative findings. related to H^ and Hg would suggest that the literacy 
skills and motivation of learners are relatively more Important than 
cultural attunements of PI In predicting learning outcomes. More 
successful, more motivated learners appear to achieve more through PI 
than less successful, less motivated learners* regardless of efforts to 
adapt the method to the culture of the learners.' 
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5« Adaptations of PI in the direction of group and discovery 
teaching methods are relatively more productive for traditional 
learners than for modern learners » This conclusion Is supported by a 
comparison of relatively Inconclusive findings related to Hypothesis 
thut the modernity of learners affects the degree to which PI (under 
all treatment conditions) facilitates learning— with the consistent 
and quite conclusive findings related to Hypotheses 7a and 7i> In which 
less modern learners— when compared with modern learners-- 
achleved relatively more through group and discovery treatments. 

Interestingly, the Interaction between modernity and expository- 
discovery treatments was not In the direction hypothesized. Hypothesis 
7b stated that the expository program condition (more culturally 
attuned) would be relatively more productive for traditional learners 
than for fnodern learners; Instead* the discovery program condition was 
found to be relatively more productive for these learners. Implications 
of this unexpected finding are discussed below. 

6. The conception of "cultural attunement" embedded in the 
r&tionale for hypotheses tested in the research must be reformulated 
(I) to distinguish between "attunement" as a process and "attunement" 
as a product } and (2) to account for the complexity of factors 
involved In attuning teaching to culture. 

Within the context of the present research, "attunement" has 
been treated as a process. An attempt has been made to adapt teaching 
to a Brazilian milieu along expository-discovery and individual I zed- 
group dimensions. Clearly a process Is not the same as a- product; 
attempting Is not the same as achieving! Mixed and unexpected findings 
in the present investigation (for example, tho discovery treatment, by 
definition less culturally attuned, and the group treatment, by 
definition more culturally attuned, were both more productive for less 
modern than for more modern learners) indicated that efforts to attune 
teaching to culture were not wholly successful. A true matching of 
teaching and culture (attunement as a product) Is probably not attain- 
able without an exhaustive awareness of complex factors involved In 
adapting teaching to culture (attunement as a process). An understanding 
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of factors Inherent in individual differences among learners appears 
to be especially crucial in adapting teaching to culture. In other 
words, the present state of the development of ethnopedagogical theory 
is not adequate as a basis for highly reliable (predictable) attunement 
processes. Efforts to attune teaching methods to the cognitive 
characteristics, learning styles, pedagogical expectations, and 
preferences of learners should be carried out with due caution and 
humility! 

The inadequacy of the present state of knowledge does not mean 
that attempts to attune teaching to culture are futile; on the contrary, 
such efforts provide indispensible data for developing cross-cultural 
teaching theory. Findings from the research reported here, for 
example, contributed to ethnopedagogical theory by revealing certain 
crucial factors along an "extent of schooling" dimension of learner 
variables which was overlool^ed In the formulation of hypotheses: 
(I) individual differences among learners in their ability to respond 
to school and non-school learning experiences; (2) the expectations of 
learners in school and non-school environments; and (3) individual 
preferences for teaching methods growing out of successful learning 
experiences within school and non-school environments. Further 
investigations within an ethnopedagogical framework may be expected 
to make similar contributions to cross-cultural teaching. Hopefully, 
an accumulation of such contributions will eventually make a true 
cultural attunement of instruction possible. 

Implications for Teaching 

Because the research was conducted in the field in a reality 
setting, the resultant findings have immediate and direct implications 
for teaching. Some of these implications are discussed below. 

Implications for Programmed Instructior .— Experimental and 
observational findings from the research provided quite conclusive 
evidence that PI is an effective method for adult basic education in 
a Brazil ian mil leu. 
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Students in all treatments adapted quickly to the use of PI. 
Most comments, questions, and otiier observable reactions to PI were 
made within the first half-hour after the method was introduced. 
Beyond this initial period, students were accepting and behaving 
appropriately to the e^tpec tat ions of the method. An overheard con- 
versation during the second session was typical: "The course is 
easier today.'* "That's because we've been practicing this method." 

Analyses of variance of the over-all means on selected pretest- 
posttest-delayed posttest measures (shown in Table 20) resulted in 
highly significant F-ratios. 

Recurring comments by students provided additional evidence 
that learning was taking place: "This course helps me do my grocery 
shopping"*, "When I eat, i think about which foods belo^ig to which 
groups"; "We are planning our menus at home around the four food 
groups"; and "I wish my daughter could take this course." (At least 
one student learned the lesson too well. Her comment in an oral 
interview was, "i eat enough fruit now, something I didn't do before." 
This same woman was given a low score on the written posttest because 
the diet she planned was badly overbalanced with fruits and vegetables!) 

The above data suggest that educators may introduce PI as a 
method of adult basic education in Brazil (or In similar cultures) with 
reasonable confidence that learning will occur. 

Certain problems in implementing PI were observed in the 
research. One of these problems was a strong tendency to copy feed- 
back. In a typical incident, a student r^ad a frame which asked him 
to choose a fruit he liked end write It In the blank, instead, he 
carefully copied the feedback: "Your choice.'! (Happily, some of the 
students readily grasped the purpose of feedback. One woman said, 
"i made mistakes, but i didn't correct them. I wanted to check where 
I erred in order to learn.") Another persistent problem was that, at 
least at first, students perceived the programmed manuals to be tests, 
and were very concerned aboitt^ careful handwriting ahd accurate work. 
High test anxiety was noted In comments such as '*|t*s so easy, and I 
still forget." Op tfie ora] posttests, some students trjecj \o j'emefnber 
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what they had said earlier so that they would not repeat or contradict 
themselves. A third problem encountered was that many learners at this 
basic level found it hard to link reading with active responding. 
They would read an instruction such as "open the envelope inside the 
back cover," and ask, "Shall I open the envelope now, or go on reading?" 
These and other problems will need to be overcome if tite maximum 
effectiveness of PI as a method of adult basic education is to be 
realized* 

Implications for Group Interaction in PI .— Findings from the 
research did net contra Indicate the use of PI In group modes. Group 
methods were shown to be at least as effective as Individualized 
methods; they appear to be especially beneficial for less modern 
learners. On a key retention measure, for example, traditional 
learners achieved more In the group treatment while modern learners 
achieved more In the Individualized treatment. This interaction Is 
II lustrated In Figure 1 . 

In spite of the demonstrated effectiveness of group methods of 
PI, an initial resistance to being required to work together was 
observed. In mors cohesive groups, the resistance broke down rapidly. 
A strong esprit de corps evolved In which students helped each other, 
joked, and engaged In lively discussion^ and arguments. In less 
cohesive groups, work In teams was difficult to establish. Students 
became Impatient with each other. The group treatment was least 
effective In a 1 Iteracy school setting where students previously had 
been told by local teachers not to converse In the classroom. One 
younger woman at the literacy school asked, t(>.,'edu1ously, "You mean 
you really want us to talk aloud to each other?" This student was 
obviously troubled by the conflict between her expectations regarding 
classroom behavior and the requirement of working with others. In. 
these kinds of situations, group activity will need to be legitimized 
beforct the method can be used effectively. 

Ample time was another crucial factor in Implementing the 
group treatment. The condition did not function well when pressures 
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Figure 1 . — Interactions between high (HI) and low (LO) 
modernity (MOD) and individualized (IND) and 
group (GRP) treatments on a delayed posttest 
measure of batance of diet. 



ERIC 



168 

were created by a late hour on a week night, or by a fixed class 
period In a school situation. 

The group treatment worked best when teachers and the Investi- 
gator maintained a low profile, If teachers were too readily avail- 
able, there was a tendency to revert to teacher-led discussions. 

Three roles developed within almost every groups (1) surrogate 
teachers, who became task leaders, explaining lessons and helping 
colleagues; (2) jokesters, the social leaders of the group whose 
constant jokes were rewarded with laughter and appreciation from their 
colleagues; and, (3) resistors, who wanted to work alone, sulked, 
argued, and were generally impatient and disagreeable. 

The above observations lead to generalizations that group 
methods are effective for adult basic education In Brazil, but that 
group skills need to be taught. Unnecessary time pressures and 
competitiveness should be avoided. Efforts to Introduce group condi- 
tions of Interaction will be most successful In cohesive groups where 
a strong esprit de corps Is present or can be created. 

Observations of Responses to Expository-Discovery Methods . -- 
Qualitatively different classroom climates were created by expository 
and discovery conditions of PI. The expository treatment sessions 
were characterized by mildly positive affective expressions. By 
comparison, the discovery treatment sessions were much more charged 
with emotion. The students In discovery treatments were alternatively 
excited, enjoying themselves, nervous, tense, anxious, arguing, and 
demonstrating feelings of frustration and hostility toward the method. 

The students In expository treatment found the method easy to 
cope with. They did not need or want the eight frames of teacher 
guidance which were provided to Introduce PI. They understood what 
was expected of them Immediately, and wi ked independently, 
efficiently, and confidently. Students and teams competed among 
themselves to see who could finish the lesson first. They made few 
requests for teacher help. 
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In contrast, students In discovery treatments had difficulty 
In coping with requirements such as reaching generalizations 
Inductively. They required more support from both their colleagues 
and the teachers. Frequent expressions of frustration at "Socratlc" 
elements In the lessons were noted. For example, the first lesson 
called for organizing food cards Into groups and preparing a food 
chart. As soon as this task was accomplished, students were asked to 
rescramble the cards. The reaction of one student to this requirement 
Is typical: "The book must be joking. I'm going to rest a little 
first." 

In the midst of the difficulty they were encountering with the 
method, experimental findings suggested that students In the discovery 
treatment were thinking more than those In the expository treatment. 
The discovery method seemed to be especially beneficial for learners 
who were less Integrated Into the formal educational system. An 
example of this trend Is shown In Figure 2. On measures of a tendency 
to copy feedback In programmed lessons, learners who had experienced 
less school success resorted to mechanical techniques (copying answers) 
In the expository treatment more often than their more successful 
counterparts, particularly when left "on their own" on lessons completed 
at home. In the discovery treatment these differences all but d Is- 
appeared; all students seemed to be thinking more. 

Thus findings from the present research do not justify the 
hesitancy educators sometimes feel about Introducing "foreign" methods, 
such as discovery teaching, Into a culture. Discovery methods appear 
to be at least as effective as expository methods for Brazilian 
learners (they even surpass expository methods on some measures of 
thoughtful behaviors and retention of learning). Units of study which 
encourage thoughtful, constructed, and divergent responses to programmed 
Items seem to be especially beneficial for learners who are less 
integrated Into the formal educational system (less literate, less 
modern, and less motivated learners). 
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Other Implications for Cross-Cultural Teaching .* -In addition 
to the method-specific Implications for teaching discussed above, 
findings reported In present research have other, more generalized, 
applications to cross-cultural teaching. 

Cross-cultural teaching must recognize individual differences 
among learners. For example, at almost every site some older persons 
were weak In reading and writing skills and had difficulty keeping 
pace with the group. Many of these students found writing tiring. One 
gray-haired woman exclaimed that she had never written so much In her 
life. Typically, some students forgot their glasses and would go home 
to get them or borrow a pair from a colleague. Experimental findings 
corroborated these observations of problems encountered by elderly 
students; older learners achieved more on oral measures while younger 
learners achieved more on wrUten measures! Such differences among 
learners within and across cultures should be taken Into consideration 
in a comprehensive plan for teaching. 

Cross-cultural teaching must also include training In thinking 
skills. Most learners in this study found cognitive requirements 
(e.g.. Inductive reasoning) extremely difficult to cope with. 

In one humorous (and probably extreme) example of the kind of 
difficulty students encountered with Inductive logic, a woman Insisted 
that papaya and oranges are not alike. A colleague explained that 
they were both fruits. The retort of the first woman was, "What good 
does It do to put things together that way? When I go to the market, 
I've got to ask for oranges." This student's comment reflects a 
healthy pragmatism that Insists on the Immediate usefulness of 
Information! It also suggests that goals of adult basic education 
should Include teaching how to think (strategies and processes) as 
well as teaching what to think (content). 

In teaching across cultures, the educator has at least three 
options. His first option Is to Introduce new methods all at once 
and with no modifications; students must adapt to him. The second 
option available to the educator Is a wholesale adaptation of 
Instructional procedures to the expectations of the learners, carefully 
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avoiding ••foreign" Innovations. As a third option, the educator may 
Introduce planned change, Initially accomiDodating teaching to the 
students' style of learning, but ultimately guiding the students 
toward optimal learning practices. The findings of the research 
reported here would encourage cross-cultural educators to opt for the 
third strategy, introducing planned change. 

introducing innovations in teaching (such as discovery and 
group methods) may be especially beneficial to less integrated, less 
successful learners within a society. Quite possibly, some of the 
school dropouts and misfits In Brazil are students who have developed 
one set of learning habits through their non-school environment, and 
have been unsuccessful in developing a new set of habits to fit the 
requirements of the formal educational structure. For these leaViiers, 
adaptations of instruction in the direction of cultural attunement to 
the non-formal, non-school milieu may be essential If effective 
learning is to occur. 
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FOOTNOTES: CHAPTER III 



^ Huber t Oyas i . ed . Reports . ^EST COPY AVAIUBLE 

^Our apologies to Malcolm Knowles, the eminent professor of 
adult education, who contends that the use of "pedagogy" Is properly 
restricted to concerns about the teaching of children. His argument, 
from the etymology In Greek, Insists on "andragogy." 

^P. Kenneth KomoskI, "April Forum: P.I. Around the World," 
Programmed Instruction, IV (April, 1965) » p. 1» 

Seth Spaulding (comp.). Programmed Instruction: An Inter- 
national Directory (Paris: UNESCO, 1967), p. Iv. 

^Interest In programmed Instruction appears to be especially 
keen In development education. Educators see In PI potential help In 
solving educational problems ranging from Improving the quantity and 
quality of instruction In the face of teacher shortages to providing 
busy farmers non-formal Instruction In basic skills. Pilot studies of 
the feasibility of programmed Instruction are being carried on In 
India by AID. UNESCO has been Involved In a variety of PI projects 
In Africa, the Middle East, Asia, and Latin America. The Commission 
on Internet ional Development has recommended greater resources for 
research and experimentation with new techniques. Including television 
and programmed learning. In Brazil, the Ministry of Education and 
Culture Is Implementing plans to use PI as a primary method In adult 
basic education. 

^Lawrence M. Stolurow, "Programmed Instruction," Encyclopedia 
of Educational Research, ed. by Robert L. Ebel (4th ed.; Toronto, 
Ontario: The Macmlllan Company, 1969). P« 1020. 

•^A fuller description of a system development approach to 
educational planning Is provided In Ted Ward, Lois McKinney, and John 
Oettonl, "Designing Effective Learning in Nonformal Modes," New 
Strategies for Educational Development: The Cross-Cultural Search for 
Nonformal Alternatives, ed. by Cole S. Brembeck and Timothy J. Thompson 
(Lexington, Mass.: D. C. Heath and Company, 1973)* PP* 111-124. 

0 

Henry Burger, Bthno-Pedagogy : A Manual in Cultural 
Sensitivity with Techniques for Improving Cross-Cultural Teaching by 
Fitting Ethnic Patterns (Revised ed.; Albuquerque: Southwestern 
Cooperative Educational Laboratory, 1971 )• 



193 



ERIC 



0(201 



19^ 



9 

"^Lots McKinney, "Cultural Attunement of Programmed Instruction: 
Individual I zed "Group and Expository-Discovery Dimensions" (unpublished 
Ph.D. Dissertation, Michigan State University, 1973). 

'^Burger, op. cit., pp. 98, IM. 

^Gerard C. Kress, Jr., A study of Social Facilitation During 
Programed Instruction (Pittsburgh} American Institutes for Research 
In Behavioral Science, 1967), p. 4. 

12 

Roda P. Amaria, L. A. Blran, and G. 0. M. Lelth, "Individual 
Versus Co-operative Learning," Educational Research, XI (1969), p. 103. 

13 

Meyer Fortes, "Social and Psychological Aspects of Education 
In Taleland," Africa, XI, k Supplement (1938), 30. 

14 

E. T. Hall, The Silent Language (New York: Doubleday and 
Company, Inc., I959)» p. 53. 

IS 

'Jerome S. Bruner, "The Process of Education Revisited," Phi 
Delta Kappan, LI II (September, 1971), 19. 

16 

Wilbur Schramm, The Research on Programed Instruction} An 
Annotated Bibliography (Washington, D.C.: Office of Education, U.S. 
Department of Health, Education and Welfare, 1964), pp. 3, k, 

'^Florence R. Kluckhohn and Fred L. Strodtbeck, Variations in 
Value Orientations (New York: Harper and Row, 1961). 

18 

Hal I , loc, cit, 

19 

•'E.g., Arnold Bond Woodruff, Charles Faltz, and Diane Wagner, 
"Effects of Learner Characteristics on Programmed Learning Performance," 
Psychology in the Schools, III (January, 1966), 72-77. 

20 

Everett M. Rogers, Modernization Among Peasants'. The Impact 
of comunication (New York: Holt, R I nehart and Winston, Inc., 1969), 
pp. 297-298. 

21 

Curslnho Is a dlmlnuatlve Portuguese form meaning "llt'tle 
course" and connoting both warm acceptance and short duration. 

22 

A nutrition unit developed In Brazil as a cooperative effort 
Involving the Cruzada ABC, SUDENE, and AID was selected. The Cruzada 
Is a I Iteracy/adult education program with headquarters In Recife. 
SUDENE Is a federal government agency which coordinates a variety of 
regional development programs In Northeast Brazil. 
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^\ee S. Shulman, "Psychology dnd Mathematics Education," 
Mathematics Education, SUty-nlnth Yearbook of the National Society 
for the Study of Education, Part I (Chicago: University of Chicago 
Press, 1970), pp. 23-71. 

^%nfamlllar words are defined as those not Included among the 
2,500 most frequently used words In the Portuguese language. The 
source for word frequency Information Is Charles B. Brown, Wesley M. 
Carr, and Milton L. Shane, A Graded Word Book of Brazilian Portuguese 
(New York: F. S. Crofts 6 Company, 19'»5). 

^^George Spache, "A New Readability Formula for Primary-Grade 
Reading Materials," Elementary School Journal, LI! I (March, 1953) 
l»10-il13. 

^Seth Spauldlng, "A Spanish Readability Formula," Modern 
Language Journal, XL (December, 1956), '♦33-^M . 

Manual do Escritor de Literatura para Novos Lei tores Adultos 
(Recife: Cruzada ABC, 1965)* p. 150. 

^^Robert M. Gagne, The Conditions of Learning (New York: Holt, 
RInehart, and Winston, 1965), p. 150. 

^^Thls programmed unit is available (in Portuguese) through the 
Institute for International Studies In Education, Michigan State 
University. 

^^^Portuguese versions of the Instruments described here (except 
the Otis IQ measure) are available through the Institute for Inter- 
national Studies In Education, Michigan State University. They are 
also reproduced In McKlnney, Cultural Attunement of PI, pp. 2'»2-267. 

^'william A. Herzog, Jr., Students of Cruzada ABC in Aracaju, 
Sergipes Description and Comparison by Phases (Recife: Research 
Report submitted to USAID/NEHR, June, 1970). 

Joseph Alan Kahl , The Measurement of Modernism: A Study of 
Values in Brazil and Mexico (Austin: Institute of Latin American 
Studies, University of Texas, 1968). 

^^Dlck Norton Smith and Alex Inkeles, "The OM Scale: A 
Comparative Soclo-Psychologlcal Measure of Individual Modernity," 
sociometry, XXIX (1S66), 353-377. 
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Three adaptations of the Smith-lnkeles Instrument were made. 
One. Item (FS-3), asking for the subject's opinion on family planning, 
was substituted by a less controversial Item (FS-1) from the long form 
of the Smith-lnkeles scale: "What Is the Ideal number of children 
for a man like yourself?" Another substitution was made: Item 
RE-12 ("Oo you think a man can be good without having any religion 
at all?") was substituted by long form Item RE- 11 ("What Is most 
Important In caring for a sick person, prayer or medical care?"). 
The latter Item was considered better attuned to a religiously 
oriented society than the former. A third adjustment of the Instrument 
Involved dropping one of the behavior Information Items (AC-1,2) because 
similar Information had already been provided through Questionnaire A 
(Item 28). 

35 

Smith and Inkeles, ioc. cifc. 

36 

Detailed validity and reliability Information regarding the 
instrument Is available In Smith and Inkeles, ioc. cit. 

37 

Paraphrased from an unpublished report (In Portuguese) on the 
Intelligence testing phase of this investigation (J. N. Paternostro, 
Pesquisa do Nivel Mental em um Grupo de 169 Adultos da Cidade de Sao 
Paulo atraves do Teste Otis), Available through the Institute for 
International Studies in Education, Michigan StateUnlversity. 

38 

Untitled review by Alfred Yates In Oscar Krisen Buros, ed.. 
The Fifth Mental Measurements Yea^rbook (Highland Park, N.J.: The 
Gryphon Press, 1959), pp. 499-500. 

39 

Portuguese, da escolha. 

Translated from the Portuguese Instrument. 

Translated from the Portuguese Instrument. 

Instructions for the Individualized treatment were; (1) read 
the page, (2) do what the book says, (3) turn the page, {k) check your 
work, and (5) go on with the lesson. Instructions for the group 
treatment weret (1) one student reads the page, (2) all do what the 
book says, (3) all turn the page together, (k) all check and discuss 
their work, (5) another student reads the next page, etc. These 
Instructions were explained by the teacher and displayed on classroom 
posters. 

^3 

Lesson k provided Instruction which was unrelated to the 
posttest task, so that the sequence of Instruction would allow a 
retention test during the last class session. 
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'^Vee J. Cronbach, "The Logic of Experiments on Discovery," 
isarning by Discovery: A Critical Appraisal, ed. by Lee S. Shu 1 man 
and Evan R. Kelslar (Chicago: Rand McNally and Company, 1966), 
pp. 76-92. 

^^Shulman, Psychology and Mathematics Education, pp. 23-71 • 

''^Results of these analyses are reported In McKtnney, Cultural 
Attunement of PI, pp. 108-177. Original caie data are available 
through the Institute for International Studies In Education, Michigan 
State University. 

^''schramm. The Research on Programed Instruction, pp. 3» ^» 

^®The problem encountered here Illustrates a recurring dilemma 
In curriculum research. A decision to control the teaching environment 
Increases the precision of the treatment (and, consequently, the 
possibility of statistically significant findings) but decreases the 
applicability of findings to real settings In which teaching variables 
can and do Interact In a variety of ways. On the other hand, a 
decision to create a less controlled teaching environment increases 
the applicability of research results to natural settings, but-- 
through the Inherent risk of confounding variables and weakening 
contrasts between treatments— decreases the possibility of statistically 
significant findings. 

^^M. C. Wittrock, "The Learning by Discovery Hypothesis," 
Learning by Discovery i A Critical Appraisal, ed. by Lee S. Shulman 
and Evan R. Kelslar (Chicago: Rand McNally and Company, 1966), 
pp. 33-75. 

^®R. Thomas Tanner, "Discovery as an Object of Research," 
School Science and Mathematics, LXIX (1969). 6'»7-655. 

^'g. D. Hermann, "Learning by Discovery: A Critical Review of 
studies," Journal of Experimental Education, XXXVI M (Fall, 1969)* 
58-72. 

^^In the present study, the students who reported the most 
modern school experiences happened to be attending an adult literacy 
school where relatively modern teaching methods were being employed. 
Thus this measure could more accurately be interpreted as a measure 
of the relative effectiveness of adult remedial or childhood education. 

^^Davld P. Ausubel, Educational Psychology: A Cognitive View 
(New York: Holt, RInehart arid Winston, 1968. 

^St is conceivable, of course, that forms of cultural 
attunement other than those assumed to be Important In this research 
would produce different results and different conclusions. 

^^cf. Cronbach, loc, cit, 
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CHAPTER IV 



INCREASING LEARNING EFFECTIVENESS 
THROUGH EVALUATION 



Ted Ward 
John M. Dettont 

* 

Ignorance forces us to try anythingJ 

The recent period of rising nationalism In Latin America and 
the post-colonlal period of national rebirth In Africa and Asia has 
coincided with a time of worldwide Inventiveness In education. There 
Is no shortage of Ideas and models for educational Innovation and no 
shortage of willingness to try new solutions for old problems. Without 
doubt, In much of the developing world the colonial ways persist In 
many Institutional forms, and formalisms In education are among the 
more resistant to change. Whimsical alternatives or additions to 
time-honored ways and means of education are relatively short-lived 
unless they clearly show superior results— as viewed by the powerful 
decision-makers. Therein lies a matter of great professional concerns 
through what processes will the innovations be identified as being 
promising and worthy of continuation? 

Within the non-formal sector, there have baen particularly 
Impressive Innovations. Partly because of their relative freedom 
from traditions and partly because of their pragmatic concern for 

"Oettlnger, Run Computer Run, p. 224. 
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getting a Job done, many programs of non-formal education have been 
quick to adopt technological Innovations. Television, programmed 
Instruction, motion pictures, audio and video recordings are as com- 
monly found In non-formal education as In formal education. In more 
highly developed countries, at least, these devices of Instructional 
communication are more typical of non-formal education than of formal 
schooling. Thus the basis for continuation, suspension, or Improve- 
ment of the uses of technology Is especially problematic. 

Conceptual Background 
Specialists In Instructional technology are quick to point out 
that the essence of effective use of modern Instructional devices and 
procedures lies less In the machinery than In the design of the 
Instructional communication. The technologist's flow chart or 
schematic diagram usually begins with "specification of objectives" 
and ends with "evaluation." These concerns (and the underlying concept 
of achieving learning objectives effectively) are as dear to the heart 
of the competent Instructional technologist as are gadgets and 
machines. In fact, the mechanical artifacts are sometimes expendable! 

Evaluation Is Indlspenslble 

Evaluation Is Interlocked with learning effectiveness. Since 
effective consequences of Instructional deliveries are of the learning 
experiences themselves Is of fundamental concern to non-formal 
education, evaluation Is Indispensable. Although an established form 
of education— especially a formal school— can survive for many years 
on the momentum of Its entity, non-formal education operations- 
especial ly those that are created to accomplish specific objectlons-- 
are not apt to survive unless they can demonstrate that they are 
performing their Intended function. 

For well-designed Instruction that can be held accountable to 
deliver effective learning planning (specification of learning 
objectives. Identifying learner characteristics, and designing a 
coordinated delivery system) Is most certainly basic. But the 
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realization of the Intended objectives and the effectiveness of the 
delivery system cannot be taken for granted. Evaluation Is 
tndispenslble. 

In scientific terms, evaluation Is an Important procedural 

basis for discovery. What has been accomplished, which Intended 

outcomes have been achieved, what weaknesses or failures have occurred 

and what Importance should be ascribed to each of these. Educational 

evaluation from a technological viewpoint, has much In common with the 

concerns of any other social process evaluation. In reference to the 

evaluation of Its Investments In social progress, the Inter-Amer Ic&n 

Foundat Ion wr I tes : 

This answer alone, however, is not sufficient. One also 
needs to know how and why the project produced the results 
measured, be they negative or positive. Thus, there is a 
need to critically observe the evolution of the project 
over time, using as many techniques and "disciplines" as 
are needed to understand the type of project in question. 
In this way one learns of the processes of change as well 
as the results and hopefully can see the relation between 
the two (Inter-American Foundation, 1972, p. 3). 

How different from earlier times when educational evaluation 
was focused on the success or non-success of students! The techno- 
logical uses of evaluation are committed to the view that "failure" 
(non-learning or Ineffective learning) are less a matter of Inade- 
quacy In the student than a matter of flaws In the Instructional 
system. (Even the problem created by the student who lacks pre- 
requisite knowledge is seen as a failure of the instructional system's 
screening or remediation procedures.) 

in this era of technology, evaluation is socially respectable- 
even expected. Evaluation— especial ly testing of students— has long 
been a standard part of formal education. As more and more organiza- 
tions, producers, publishers, and distributors become involved in the 
supplying of educational materials and resources, they become caught 
up in the demands for evaluation. Within American education today, 
for example, "accountability" has become a watchword. Is it worth 
what it costs? Does it do what it is supposed to? Is X, better than 
Y? These are the new questions being asked within the educational 
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establishment, replacing or augmenting the historical evaluative 
questions focused on "how well Is Freddy learning?" 

Research of any sort Is generally limited by the questions It 
is able to ask with precision. For example, the findings of an evalua- 
tion can be no more precise than the questions posed. Three problems 
enter at this point: costs, time, and specificity. Sometimes too 
many questions are asked— administrators of educational programs tend 
to assume that where an evaluation Is underway It Is as easy to find 
out ten kinds of Information as It Is five. But evaluators know that 
answering questions Is costly, and the more questions, the higher the 
cost. Another problem arises when Important questions require long 
periods of time to get responsible answers. For example, longitudinal 
studies of months or years duration are necessary to evaluate certain 
long term Impacts and case-study effects. A problem even more 
difficult than time and cost Is the lack of clearly specified objec- 
tives. When only generalized statements of objectives and platitudi- 
nous goal statements are available, hardly any questions can be 
asked In a precise manner. Thus the first task for the design of an 
evaluation Is to Identify worthy questions which could be answered 
specifically within the time and cost constraints of the requested 
study. 

Two Kinds of Evaluation 

Summatlve Evaluation 

Technologists see two different sorts of evaluation— a distinc- 
tion more of Intended uses of the evaluations than of differences In 
procedure. First, and most familiar Is summatlve evaluation— Intended 
to provide a basts of Judgment of the worth of the effects of the 
Instructional program, material or experience. Summatlve evaluation 
Is generally based upon measurements of the resultant learning or 
perhaps the residual learning available to be applied In real sttuatlonsi 
such measurements are assessed against either pre-test data taken 
before the Instructional experience, or against the specifications of 
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Intended achjevements, or both. Sumioative evaluation, at Its best, 
Is a judgment of social worth of a program, material, or experience, 

The basis for assessment in summative evaluation is usually 
the intended outcomes. What actually results from an educational 
program is compared with what was intended and is judged to have 
reached or not reached satisfactory levels of outcome. (As we will 
see later in the chapter, the assessment looks at differences between 
Intended outcomes and actual outcomes, or between needs and satisfac- 
tions of those needs; but the evaluation itself is based upon a value 
position that sets forth what is satisfactory or unsatisfactory.) 

Figure I shows the basis of assessment in the typical summative 
evaluation. Simply stated, the question Is, "did the operation 
accomplish what was Intended or needed?" The secondary but also 
Important question (Q2) asl<s whether or not It was the educational 
program Itself or some other social event that led to the actual 
outcomes. 



Intended 
Outcomes 



1 
1 






Educat ional 


1 


1 


Program 


1 
1 












Actual 






Outcomes 





Figure I.— The Three Bodies of Data Necessary for 
the Typical Summative Evaluation. 

Formative Evaluation 

Formative evaluation, the second of the two major sorts of 
evaluation, has come Into Its own largely bacause of a recent 
coinage of terminology. In terms of Its purpose--gett Ing Information 
that can lead to the Improvement of an educational program, material 
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OP experience-- It Is hardly new. One of the time-honored uses of 
evaluation Is to make changes. In the way formative evaluation occurs 
In schooling, the change may be to return a pupil to an earlier 
experience or status, to terminate the services of a teacher, or to 
seek out a replacement textbook. Today formative evaluation Is 
acknowledged as the beneficent provider of Intelligence with reference 
to Improvement of education (despite the fact that evaluation Is 
Incapable of telling what ought to be done In place of something that 
isn' t working wel 1 ) . 

"If a thing Is worth doing. It's worth doing badly." In these 
words G. K. Chesterton suggested that necessity often works against 
perfection. The necessity of meeting diverse and compelling human 
needs In a complex and ever-shifting social environment demands 
Invention, revision and change. In such circumstances It Is often 
necessary to do things badly. Faith In one's goals Is more appropriate 
than faith In one's methods. 

On first hearing, Chesterton's assertion has a tone of defeat 
and resignation. For the perfectionist It strikes a discordant note, 
seemingly Inconsistent with high and noble contentions. The practical 
logic of life, no matter how commonly practiced and easily accepted as 
behavior. Is often startling when put Into words. Thus when the 
Importance of doing something Is contrasted with the quality or 
effectiveness of the doing, the practical logic of life says "do 
something-- anythlng l" 

Traditionally, the role of evaluation In education and other 
institutions of social change has been to detect, assess, and weigh the 
Importance of the consequences or effects of what has been done. How 
well, how much, for whom, at what costs are the typical Issues 
examined by evaluative efforts. Evaluation has been more concerned 
with Chesterton's "doing things badly" than with making them better. 

In recent years, the technology of evaluation has undergone 
important changes. The use of electronic computers has stimulated a 
variety of Innovations, particularly related to collecting, storing 
and analyzing gr^at quantities of data. But one of the most Important 
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changes Is more conceptual than technical j edgcat tonal evaluation Is 
recognized as valuable for two different sets of purposes? formative 
and suniniatlve. Most of the uses of evaluation In the past were 
suminatlve . In that they were concerned with summations or conclusions 
about consequences and end products. Today evaluation Is also 
designed to serve as an aid to the planning and development process; 

evaluation Is designed to provide feedback data that will 
shape and reshape the educational operation until Its procedures are 
appropriate for reaching Its goals. 

The basic assumptions underlying formative evaluation are the 
fol lowing: 

1. An educational program Is an Imperfect venture, achieving 
somewhat less than competently what Its operators Intend; 

2. The most important purpose of evaluation Is improvement 
of the operation; the Important judgments to be made 
are those that relate to factors which can be altered, 

Thus the purpose of formative evaluation Is to provide data 
and judgments which will be useful in mal<ing an Imperfect operation 
better. The logic of formative evaluation is altogether consistent 
with the real world of needed social action and contextual uncertain- 
ties: it relates to systems in process , not after the fact; and it 
seeks to provide ways and means of Improvement rather than to pass 
judgments that will discourage and defeat wel 1 -mot ivated efforts. 

To add to Chesterton's assertion, formative evaluation Is 
committed to the proposition that anything worth doing Is worth doing 
badly at first . 

Figure 2 summarizes the major distinction between the two 
purposes of evaluation. The questions that are raised in formative 
evaluation are directed toward the purpose of making Informed change 
In the educational efforts. The questions In summatlve evaluation 
are those more classically assigned to the task of evaluation as the 
provider of ultimate judgment about the worth of effects. 

The probability that a non-formal educational operation will 
be seen as Imperfect and in need of change Is at least as high as In 
formal education. Especially In reference to deliberately planned 
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CAM (T BE MADE. MORE. 
eFPEOlVE ? 





Figure 2.— The Major Distinction Between the Questions for 
Formative and Summatlve Evaluation 



non-formal education, the Intended outcomes are usually stated or 
implied in specific reference to skills and competencies that are 
specific, describable, and relatively easy to assess. Further, the 
societal needs to which non-formal education programs are commonly 
related are usually demanding enough that malfunction of the educa- 
tional program will be promptly seen and felt— felt as frustrations 
and compounded problems In the society (unlike formal education wherein 
malfunctions are sometimes undetected for generations). Thus non- 
formal education, at least as much as formal education can use evalua- 
tion as a tool through which to make orderly change toward increased 
effectiveness. 

Since the distinction between formative and summatlve Is con- 
cerned with the purposes of evaluation, these terms do not necessarily 
indicate separate kinds of data gathering or different kinds of concerns 
about reliability and validity. Formative evaluation is Intended to 
provide Information on which judgments can be made about the effective- 
ness and worth of the educational experience and the materials and 
procedures that produced It. 
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Evaluation Relates to Theory 

In order to enhance the usefulness of formative evaluation 
and In order to provide a comprehensive value position for summatlve 
evaluation, a statement of the theoretical position about the 
Intended learning and the appropriate learning experiences Is 
Indispensable. The theoretical position statement will serve as a 
basis for all evaluative operations and as a point of reference 
toward which to direct all evaluative conclusions. 

The complex forms of non-formal education— for example, 
community development education— require much Invention of methods 
and procedures. It Is commonly reported even within unified programs 
that each situation is significantly different and that each applica- 
tion of a general methodology requires variations and adjustments In 
order to properly relate to the "local situation." The Invention, 
or "local adaptation" as It is usually called, may take place within 
a general theory of educational methodology, but will succeed or fall 
In reference to the appropriateness of the adaptations. The commonly 
observed Irregularities and unevenness of learning effectiveness from 
one location to another can be reduced In two different ways: (I) more 
careful Implementation of the general theory upon which the program Is 
based, and (2) more careful adjustment and adaptation to the local 
situation. In reference to the first, the general theory will Itself 
need to be under constant reexamination and revision on the basis 
of feedback from the field operations. The second, adaptation to the 
local situation, also demands that feedback be made available and 
used by the staff and leaders of the field operation to decrease the 
discrepancy between Intended and realized outcomes (see Figure 3). 

The Relation of Evaluation and Change 
Evaluation Is a point of contact between science and management. 
Evaluation Is neither purely science nor purely management. A well 
designed evaluation program takes account of the rudimentary results 
of scientific Inquiry In order to reduce the likelihood of biased and 
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Figure 3.— Symmetrical Model of Feedback to Field 
Operations and to General Theory. 



and misleading findings. In management terms, an effective evaluation 
program enlightens decision-making. 

Figure 3 suggests the sort of Information flow that exists 
within an organization In whirh Invention and discovery are seen as 
tools to produce Increased effectiveness. The various field operations 
are based on a general theory (a more or less specific statement about 
the nature of the task to be done, the methods to be used and the 
results to be expected). The field operations and the effects they 
produce are constantly being examined for evidences of substantiation 
or challenge of the general theory. The effects In the field are 
also being examined with reference to the Indication of needed changes 
of the field operation Itself. In other words, evaluation Is a 
deliberate part of the strategy or approach In the field. The two 
targets of feedback,, the general theory and the field operation, are 
both important foci for the formative evaluation. The general theory 
Is the common repository of the accumulated Insights and wisdom 
derived from all the field operations; It Is a point of focus bridging 
between what is being learned in the overall program and what is known 
from the related scholarly research fields. The general theory is the 
point of similarity among all field operations— the "guiding light" 
which illuminates similarly the various specific local operations of 
the program. The other target of feedback, each local field operation, 
is a microcosm of the whole program and of the general theory. In the 
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local field operations of an Informed and competent non-formal 
education organization, the general theory Itself allows for or 
encourages an interaction between effects and procedures. Through 
this interaction procedures are adapted In certain ways In order to 
Increase the conditions and treatments that relate to learning effec- 



The figure suggests a model of feedbacl< that. Is symmetrical, 
In that the local field operations engage In a use of feedbacl< that 
Is a reflection of the use of feedbacl< at the level of corporate 
Involvement with general theory. There Is a symmetry and consistency 
between the roles of concepts of needs, procedures of Intervention, 
feedbacl< on effects and revision of the system In which the operational 
levels reflect the broader total organizational levels. 



Most competent evaluations are based on a series of four 
operations best described as a series of steps or stages. Figure k 
shows that the base or first stage is description; on this is built 
measurement; on measurements are built assessments; and then, by 
bringing value positions to bear on the assessments, one can mal<e 
evaluations. 



tlveness. 



Four Operations In Evaluating 




Figure '♦.--The Four Operations of Evaluation. 
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The descriptio n of phenomena to be evaluated is a necessary 
first step. Usuaily these descriptions are verbal, though graphic and 
pictorial descriptions are often more meaningful. The measurement 
step is necessary if ciear"cut assessment is to follow. Most 
scientists in the physical and social science domains will insist that 
descriptions that have not been quantified are an inadequate basis for 
comparative analysis. That differences may enlst can sometimes be 
determined "by inspection," but without measurements (expressions of 
the descriptions in numerical terms) the significance of the con- 
trasts can be stated only subjectively. 

Comparisons of two or more measurements constitutes assessment . 
Two scores representing two different learners can be used to assess 
that one has achieved more than the other. Two measurements taken on 
the same learner at two different times can be used to assess that a 
learning gain has taken place. Even the statistical significance of 
these differences (gains, losses, relative competencies, etc.) can 
be determined as assessment activities. But to say that the gain is 
important , that the learner has achieved well , or that the competency 
is adequate requires a step beyond assessment; such judgments are 
representations of the outcomes of evaluation . Evaluation is the 
process of putting a value judgment on the conclusions of an assessment. 
Or, putting It another way, evaluation is judgment of the worth or 
Importance of an empirical finding. 

That "goodness" is very much a relative matter In educational 
evaluation is illustrated by the contrast between conclusions one 
draws from two different value positions} assuming that educators are 
concerned about both growth and competency , each can be taken as a 
value position. Assume that the following scores for a set of five 
learners represent a pre-test before a learning experience. (The 
students are named Angela, Bob, Carlo, Dominique, and Eric.) 



A 



B 



12 



C 



10 



D 



E 



7 




2)0 

After the learning experience, the following scores might 
result from a second measurement on the same test used for the 
pre-test : 

A 18 
B 14 
C ]k 
D \k 
E 9 

An assessment of these measurements a1 lows expression of the 
scores as differences, "growth," or learning scores: 

A +i» 
B '¥2 
C 

D +7 
E +5 

Which learner did better? Who is the best or who Is better 
cannot be answered until we take a value position. For example. If 
one assumes that competency Is the value ("competency Is more Important 
than growth") then clearly Angela is more competent In this skill or 
knowledge— before and after the learning experience. Eric remains the 
least competent. Bob, Carlo, and Dominique seem now to be equally 
competent. This evaluation Is based on an assessment of the differ- 
ences of the various post-test scores In light of the competency value 
position. Thus when we note that Angela "did better" we are evaluating 
on the basis of competency. 

If we accept another value position, that growth Is more 
Important than competency, then Dominique "did better." In terms of 
growth, Dominique's 7-polnt gain Is the largest, and for this value 
position the largeness of gain Is the basis of Judgment or evaluation. 
Note that this evaluation uses assessment data from the pre-tests and 
post-tests expressed as amount of differences between the two. 

In evaluating an Instructional material or procedure, we are 
sometimes concerned more about growth than about competency. This Is 
especially true when the common schools (public and private elementary 
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and secondary schools) are the focus or locus of evaluation and when 
no common agreement exists about what constitutes competency in the 
given subject matter. In non-formal education, however, the skills 
and concepts being taught are commonly "practical," with observable 
applications and consequences. Thus It Is especially important for 
non-formal education to accept responsibility for providing effective 
learning experiences and to state the levels of competency intended 
and to evaluate accordingly. 

The lack of standards of competency in a given learning 
increases the difficulty of summatlve evaluation, especially. Summatlve 
statements In such a case are necessarily limited to comparisons 
(material X "does more" than material Y^) and to pragmatic statements 
about whether or not an Instructional material "works" (has effects on 
learners). Evaluating whether the effects it has are "adequate" to 
bring a person up to norms and whether the rate of change Is worthwhile, 
In terms c? cost-benefit ratio or in terms of instructional time 
expended, are very difficult and sometimes impossible tasks. These 
problems, common to valid evaluation In formal education are less 
Inherent In ski 1 1-oriented non-formal education. 

When Issues regarding quality criteria (value positions) are 
left unresolved, summatlve evaluation Is often diverted to focus on 
other and less worthy questions than the worth of the learning gained. 
For example. It Is common to find summatlve evaluations concentrating 
on the teachers' opinions or estimates of the worth of the experience, 
the students' Itktng or disliking of the experiences and materials as 
reported by opinion surveys, and the use of highly subjective and 
non-representative anecdotes as a basts for passing judgments. This 
sort of evaluation Is potentially misleading unless kept In Its place 
within a more comprehensive evaluative framework. 

Measurement problems also thwart well -Intent toned evaluation. 
Especially In the affective domain, where learning Is very closely 
geared to 1 Ife-style-determtnIng personality and value-system 
variables, measurement Is extremely difficult. Verbal responses In the 
affective domain often bear little resemblance to the concomitant 
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behaviors. ("What you ar;e speaks so )oud)y I cannot hear what you 
say.") Verba) data on written tests or Interviews rarely can be 
taken at face va)ue. It Is too easy to misrepresent onese)f, 
enhancing one's ego or suppressing guilts and fears; and even when a 
person wants to be "open" and honest he may not be sure enough of 
his owr feelings ("the rea) me") to be able to speak or write with 
conf'H,;nce. Since unobtrusive observation of the behaviors that 
reflect true affect are awkward and usually very cost)y, verbal se)f'' 
report Is usually utll{;!ed to get quantifiable data. The validity of 
such data Is always open to challenge. 

Now that the accepted way to begin the design of an instruc- 
tional system or component Is to carefully specify the Intended 
behavioral outcomes or objectives, another problem of evaluation has 
arisen. An overly-ambitious assumption tends to accompany the emphasis 
on behavioral objectives: If a learning objective Is well-defined It 
is likely to be achieved." The tragedy of this assumption Is that one 
tends to over-expect results from a given learning experience. 
Behavioral objectives have a characteristic tone of finality; for 
example, "When confronted by the question, 'What Is the sum of two plus 
two?" the learner will respond 'four,'" has the ring of always and 
forever . Experienced educators are more familiar with the tentative 
nature of new learnings and the distinct possibility that a learner 
will know something today and not know It tomorrow. The persistence 
of learning Is not the Issue here--though the research on forgetting 
is a sizable and Important body of literature, but a tendency to ask 
evaluative questions that are too ambitious (too demanding) Is our 
concern. The probability of any given brief Instructional experience 
leading directly to life-changing consequences Is remote. Thus it 
seems unfair If not Irresponsible to take a list of Intentions 
ascribed to a given Instructional material or experience and to 

This assumption Is seen in. the technologist's views that the 
objective should also serve as the basis for an item in the achievement 
test and that a wel 1 -designed Instructional system Is based on the 
realizable Ideal of all appropriate learners achieving all specified 
teaming objectives. 
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evaluate an instructional material exclusively on the basis of pre** 
test and post-test of these traits or behaviors in learners. 

Instead, responsible evaluation looks at the larger scope of 
a series of learning experiences. Rather than picking out the 
miniscule contributions of some small portion of the series, such as 
the learning gain in a particular lesson, the particulars are better 
examined as they relate to some larger whole . Obsession with 
objectives at the expense of the concern for the gestalt of goals 
can result in a fragmented evaluation. 

For many non-formal education programs no lists of specified 
instructional objectives are ayai table: usually there are, instead, 
strongly worded statements of intention reflecting a set of fervently 
held values and aspirations. The sources of .worthy questions for 
summative evaluation will certainly include whatever general state- 
ments may exist, yet inference and extrapolation will be needed in 
order to convert generalizations into appropriately specific questions. 
Useful questions that can lead to summative evaluation of non-formal 
educational experience usually can be inferred from the value positions 
implicit in the program or its stated goals. For example, if a value 
position is held that a learning experience should be meaningful , 
then it is possible to evaluate on the basis of an assessment comparing 
the intended messages and messages received, if the capability of a 
learning experience to hold the interest of the learner is valued, an 
evaluation can be based on an assessment comparing immediate and long- 
term recall or comparing the intended and realized responsiveness of 
a learner or group of learners. 

In strictest terms, a descriptive research is not the most 
explicit form of evaluative study. The constraints of time and costs 
as well as the difficulty of measuring the particular form of intended 
learning sometimes demand that an evaluation utilize descriptive 

Attention is directed to the superiority of evaluations 
based on this sort of direct investigation of the target audience over 
the indirect estimation by an intermediary person or group, e.g., 
asking teach«irs if they think the experience was meaningful for their 
students or if It was interesting to the students. 
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research methodology rather than purely evaluative methodology. Such 

a study would be focused on what seems to be happening rather than on 

establishing an empirical or scientific case for how good or how 

Important the learning is. 

Sample questions of the sort that a summatlve evaluation might 

attempt to answer through the descriptive research are the following; 

Does the learning experience carry a message that Is 
meaningful to the Intended learners? 

Is the learning experience recognizable In relation to 
needs the learner sees as significant? 

Does the learning experience tend to cause the learner 
to apply himself to concepts and skills that are higher 
than those he currently holds? 

Does the learning experience affect the learner's behavior, 
and, If so, In a desirable direction? 

Does the resultant learning fit into a supportive 
environment in terms of the reward systems to which the 
learner Is related? 

These questions are summattve In nature and their answers, 
in the affirmative, would seem to be basic to any claims for 
satisfactory performance of any non-formal education program. 

Formative evaluation Is somewhat easier to describe, yet the 
questions it suggests are so abundant as to mal<e an exhaustive list 
unworkable. Virtually any information that sheds light on ways to 
improve an educational experience can qualify as formative evaluation. 
The issue for designers of evaluation is to assure responsible 
validity and reliability of such information. Theory becomes 
especially important at this point. The instructional experiences 
must have clear relationships with the value positions themselves. 
What is valued as the learning outcomes must be synchronous with the 
nature of the Instructional experiences. Assessments upon which 
evaluations will be based will have to compare the actual learning 
experiences and the specifications of experiences that are theoretically 
contributory to the intended outcomes. Thu:i the key question for a 
formative evaluation of an instructional material or procedure is the 
fol lowings 
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To what extent are the observed experiences that result 
from the Instructional material or procedure consistent 
with the theoretical model of the appropriate learning? 

From this question two others are derived, and thus are 

established two pursuant lines of Inquiry: 

1. In what ways is the Instructional material or 
procedure most deficient In comparison with the 
appropriate learning experiences for the Intended 
learning outcomes. 

2, What suggestions about improvement of the Instructional 
material or procedure can be deduced from descriptions 
of their uses? 

The first of these two derived questions Is more truly within 
the domain of evaluation since It can be answered by comparisons of 
data against a value position. The second question is hardly recog- 
nizable as a classical focus of educational evaluation, but It Is the 
crux of formative evaluation. It leads to the gathering of descrip- 
tive data about the utility of the resultant learning, the level of 
motivation, and the learning gains at several points in the series of 
instructional experiences. The particular data collected and the 
resultant findings are used In the creative process of improvement of 
the materials and procedures. Thus formative evaluation is a major 
means of Improving learning effectiveness. 

Formative evaluation is ordinarily associated with the pilot 
study of effectiveness of a new instructional material or with the 
early assessment of a new program. As such, formative evaluation Is 
expected to lead to changes. After a program of non-formal education 
has been put Into the field, continuing to carry on formative evalua- 
tion makes sense only If change and improvement is possible. If, on 
the other hand, the only decision the program will face is whether or 
not to continue, formative evaluation is less important than summative 
evaluation. 

In the case of a continuing series of materials or publications 
of which there are to be subsequent issues (not revisions of previous 
releases), or programs for which there are to be follow-on or 
subsequent "advanced" courses, there is potentially great value in 
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formative evaluation that leads to Improveuient of the series. Here 
again, theory Is especially Important. The formative evaluation must 
be focused on Improving the guidelines and models of Instruction upon 
which the programs or productions are based --somewhat a more abstract 
task and hence more demanding than the Improvement of any given 
material program. 

In order to learn as much as possible about the environments, 
the learning outcomes and the social consequences of a non-formal 
education program and In order to make useful recommendations about 
improvements of the program or the series, evaluation should be 
carried out as a vital part of the program. Descriptive procedures 
should be used extensively, augmented by evaluative procedures wherever 
the data base for assessments and the necessary value-position 
statements will al low. 

The quest for learning effectiveness Is a continuous process. 
Providing Instructional experiences that will lead to Important 
changes In a learner's life Is a most demanding task. It Is not 
enough that a certain experience would "reasonably" or "logically"; 
the real Issue Is whether or not the experience In fact , leads to 
effective learning. This Issue, effective learning, requires a 
process of continual development, not merely a goud delivery system. 

The proc'iSS through which learning effectiveness can be 
assured is, most simply stated, a series of four steps. The first 
and fourth steps are both concerned with design and planning, thus 
there are three different types of activities that can best be seen 
as a recurring cycle: 

design 

operate 

I 

evaluate 

I ■ 

re-desIgn • ■ ■ > operate ■ '-i 

-I' 

evaluate 

•I' 

re-desIgn 
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The design step consists of three functions? 

DESIGN .... Specification of goals and objectives 
Study of the target population 
Planning of the Instructional delivery system 

opQt'Qte step consists of four functions! 

OPERATE ... develop Instructional materials 

train delivery agents and/or technicians 

develop logistic and administrative support 
system 

activate program in the field 

The evaluate step consists of six functions? 

EVALUATE .. establish criteria and state value positions 

collect pretext data on the target population 

observe and describe the transactions (the 
delivery) 

collect post^test data 

assess (compare) data 

evaluate against criteria and values 

Focus on Brazi 1 
During the spring of 1972, A ID/Washington, in response to 
requests from USAiD/Bras 1 1 la, asked Michigan State University to provide 
one participant for a team of Brazilians and Americans to be assigned 
In the field as part of a countrywide survey of non-formal educational 
resources. The study h.ad been designed to identify, visit, and 
consult with three typos of educational programs: extensions of formal 
education through mass media, transformations of existing formal educa- 
tion to effect improvement of the benefit/cost ratio through the use 
of instructional technology, and non-formal programs of education 
(ranging across basic literacy, agricultural improvement, health, and 
community development). The team began its work as a whole and then 
divided into separate survey teams of four persons each, two 
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BrazDlans, two Americans. At tUe conclusion of a month-long series of 
visits across Brazil the combined team consu)ted wltli tlie Ministry of 
Education and Culture In Brasilia and prepared Its report, liiglil Iglits 
of that report fo))ow. 

Some caution Is In order. Such rapid expansion and deve)op'' 
ments, especia))y If they are successfu) , may quickly exhaust the 
resources. It Is readily apparent that sl<llled educational leadership 
may already be stretched thin. Financial resources may also be soon 
found to be inadequate. In general, educational opportunities breed 
more and more demands for educational opportunities. Whether the 
country in question Is the U.S. or Brazil, there are not enough funds 
to continue to provide more and more education of the ordinary sorth. 
Objectives as grand as those now specified In Brazil will absolutely 
demand non-trad Itlonal delivery systems. 

Faith In technology Is not well founded unless there are 
commitments and resources to follow through on a comprehensive basis. 
For example, during the period from 1955 to I965 there was much 
enthusiasm for educational technology among many innovative people and 
agencies In the United States i yet by 1965 it had become apparent that 
the many years of training many teachers to a high level and building 
fine school buildings had created an "establishment" and community 
expectation of great force. These factors have beriously impeded the 
development of much-needed improvements In cost-effective education. 

Brazil Is Indicating in many ways that it Intends to employ 
educational technology to improve the effectiveness of formal and non- 
formal education. Already it has demonstrated Its willingness to 
invest in varieties of modern med la for education. Now the problem 
of using educational technology has emerged. Trained evaluation 
specialists are in short supply. 

A by-product of this shortage of specialists in educational 
evaluation is a shortage of specially-designed demonstration programs. 
Dissemination of innovative practices could be greatly stimulated by 
a series of varied, c)ear)y defined, and we) 1-eva)uated educational 
innovations. This shortage is ironic when one )ooks at the wea)th of 
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innovations now underway in Brazil. There is no shortage of programs 
to lool< at, but there is virtually no value in these many projects if 
one is trying to decide which model or models to adopt in another 
location. The problem is the lack of objective, orderly, rational 
and relevant data about the consequences of each program in the place 
where it has been started. Thus It is impossible to predict 
reliably whether It will have any given effect in some other place. 

This last point reflects a strong conviction shared by most 
%f the team members, Brazilians and Americans alike, that the creative 
spirit evidenced in so many different educational developments would 
be more apt to lead to lasting improvements if more thorough evaluation 
were made a part of each project. 

The FASE Program of Community Education 
Of all the projects visited, only a few could be described 
as effectively using evaluation for either program improvement or 
for summative evidences of the consequences of the educational 
transactions. One of those where evaluation was being knowledgably 

it 

employed (though not for summative purposes) was the FASE,' based 
in Rio de Janeiro and operating In numerous selected sites around 
Liie country where social need was at Its greatest. We asked USAID/ 
Brasilia to investigate the possibility of our carrying on reciprocal 
consultation relationships with this organization. It was arranged. 

FASE Is an organization In which evaluation has played a 
significant part In decision-making. Affiliation with FASE for the 
purposes of further study of effective evaluation In non-formal 
education was undertaken through the help of USAID. 



'Federacao de Orgaos para Assistencis Social e Educaclonal 
(Federation of Organizations for Social and Educational Assistance). 
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For research in non-formal education, the objectives were the 
fo) lowing J 

1. To examine and describe the history of the origins 
and development of FASE with reference to the role 
of evaluation in those processes. 

2. To identify and describe the current state of 
development of the use of evaluation and evaluation* 
based decision-malting. 

3. To learn some of what the FASE tacticians and techni- 
cians have learned about effective transactions with 
impoverished people. 

For FASE, in reciprocation, the purposes were the following: 

1. To get consultation from specialists in evaluation 
design. 

2. To develop, with help from specialized consultants, 
a comprehensive plan for an evaluation system. 

These objectives have two levels of value for the better 
understanding of non-formal education. First, FASE is an agency of 
human resource development through educational processes. Its major 
forms of activity within communities are intended and designed to 
stimulate human learning processes. Although "trainings"' and other 
teaching procedures adapted from the traditions of formal education 
are used, the more basic educational processes are those historically 
and recently associated with the non-formal education: discipleship, 
participatory learning, reflection and group discussions of one's own 
social situation, community problem identification, planning and 
problem-solving through action. 

What is learned through this composite of experiences Is 
related to life and to practical applications In a more vital way 
than ever is possible through ordinary schooling. Thus the ways in 
which an organization such as FASE "puts It all together" and 
improves its aggregate of procedures is a vital determinant of learning 
effectiveness. In the view of FASE leaders and technicians, no one 
of their procedures is effective for basic human development except as 



Port*, "treinamentos". 
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It Is used as a part of a specially planned set of activities 
appropriate to the needs of a particular community. 

Second, perhaps because of the multi-national background of 
the FASE staff, or, more likely, because of their rejection of sterile 
academic traditions and their distaste for unfounded theory In 
reference to real problems, an empirical style of operation has become 
characteristic of the most effective technicians and specialists In 
FASE." FASE's empirical style of decision making Is In sharp contrast 
with the more common doctrinaire postures of many non-formal education 
organizations. Thus learning effectiveness Is defined In FASE as a 
behavioral change that has pragmatic consequences In a relatively short 
time span. To Illustrate, In an early year, the general model of 
educational development advocated by FASE was represented oy the 
following Jiagram: 



For FASE this was a working hypothesis about how effective 
learning would come about; for a non-empir leal organization this model 
would have been a matter of doctrine, to be demonstrated, preserved, 
and advocated, no matter how little evidence there might be about Its 
value or validity. After testing the hypothesis In the field through 
Its use as a general guidance for technicians and as a basis for 
developing plans with communities, the Idea of beginning with an 
Investigative "see" phase was found to be difficult and sometimes 
Impossible. For simple people lacking In experience In reflection 



"For some, the rejection of academic abstractions Is complete, 
making them— with regard to education—pragmatic activists. For 
others the challenge of relating theory to practice has become an 
Intensive concern and has stimulated In them a high degree of practical 
intellectual development. 
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upon their own condition, lacking in a basis of comparison between 
what is, and what could be, lacl<ing in experiences in which they have 
altered their own environment, the "see" experience was found often 
to be meaningless. Thus, through a process of review, evaluation 
and planning for change, PASE's general model became more lil<e the 
fol lowing : 



Example I ; A Decision to 
Change Theory.and Policy 

Since its beginning PASE has enunciated a theoretical view of 
effective community development. The expressions of this view have 
been more or less clearly stated--to some extent through a general 
model of development Intervention, and also through the actions tal^en 
by FASE--the way of worl<lng in communities, the priorities for atten- 
tion and action, and the ways In which "success" is described. This 
theoretical view has not been held constant. Through evaluated 
experience the theory has been enlightened and modified. 

One common and logical premise about community development 
worl< is that the community agent (facilitator, technician, or what- 
ever he may be catted) should become very homophtttc with the people 
he is attempting to help. This seems logically to lead to a policy 
of preferring that the community agent should tal<e up his residence 
within the community that he is attempting to help. Such a preference 
was the worl^ing hypothesis within the Guanabara Region of PASE until 
experiences of two unsuccessful community developments were evaluated 
and the hypothesis of extreme homophtltal preference was modified. 
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In the first of these cases, a technician was employed to work 
In the community of which he was a resident. After more than a year 
of work In that community, the technician left FASE to take up other 
employment. The FASE-related activities came to a halt. There was 
almost no continuity. Evaluation of the situation revealed that the 
technician had beer so much a part of the community that dependency 
had been created: everything that they had done depended on him 
personally. It was concluded that whatever objectivity he may have 
gained through his training had been lost through his Identity with 
the community. The patterns of paternalism and dependency, deeply 
embedded In the psychological structure of the people of that com- 
munity were responsive to "one of their own" as a. leader—but not to 
the extent of making themselves leaders. 

A similar case occurred a short time later, also In Guanabara. 
One of the patients at a leprosarium was hired as a FASE technician. 
His apparent Interest In the Movement of Community Creativity and 
abilities as a leader suggested that he would be an effective worker 
within the community of his fellow-patients. Even after two years he 
was not fully accepted among his own peers. They couldn't accept him 
because he showed all their own weaknesses yet had arisen In a 
meritocracy. He showed a limited understanding of how to effectively 
exert Influence. Ultimately he was tieinsferred to another center and 
he proved to be more effective In this new location. 

As a consequence of these experiences It was decided not to 
encourage technicians to live within the communities. The value of 
objectivity In the technician and the consequent Independence of the 
community during the delvelopment process came to be valued more highly 
than social Integration of the technician Into the community. The 
assessment (lack of accomplishment of objectives) and the evaluation 
led to the decision-making of a decision. The situation was studied 
and a change was made. 

In this case a logical (reasonable) viewpoint about the 
preference for hemophilic agents had been accepted as part of the 
theoretical basis of the procedures of FASE. Through the evaluation 
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of unsuccessful experiences it was possible to identify this flaw in 
the theory and to mcike appropriate changes. This change illustrates 
the major difference between useful evaluation and useless evaluation: 
it would have been useless to evaluate the effectiveness of the 
accomplishments, or even of the technicians, in these two cases if 
changes had not been possible or if changes were not to be influenced 
by the evaluations. Useful evaluation does more than provide Informa- 
tion—it enlightens the process of decision-malting. 

Example 2; Decislon--New Specialists 
or Retraining of Technicians 

In 1969, when the current Regional Coordinator began his 
work in Bel em (the Northern Region of FASE, largely rural and village 
subsistence economies in tropical flood plains and forests) there 
were four FASE technicians at work In the Region. Within two years the 
work had grown to such an extent that fifteen technicians were at 
work. In the fall of 1971 « during a periodic review, evaluation, and 
planning session (on site) with the Executive Director of FASE, it 
was determined that although the execution of work in the target com- 
munities was being handled competently, the need for over-all analysis 
and strategy development was beccming a task too great for the Regional 
Coordinator slone. Thus It was determined that one of two actions 
was In order: either a specialized staff member should be added to 
assist in the over-all development of the Regional programs or a 
series of new specialized skills would have to be learned by the 
technicians already on the staff. The first option was taken and a 
sociologist was brought onto the staff from Pernambuco (a similar 
region In the northeast of Brazil). 

The objectives of this change were defined. Specifically, the 
sociologist was to provide assistance to the Co-ordinator and to the 
technicians; the assistance was to be focused on deeper understandings 
of the communities, more specific long-range planning, and more care- 
fully matching of resources to community needs. 

After several months it was clear that the objectives were not 
being met. The major problems were identified: the sociologist was 
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not working well with the technlclansj further, his background of 



experience was not appropriate., The sociologist would need much more 
time to develop understandings and sensitivities before becoming 
effective In the ways specified as objectives. The relationship was 
terminated. 

Another session for review, evaluation and planning was held. 
The alternative decision was reconsidered, and a plan was established 
for providing support and opportunities for presently employed 
technicians In the region to get the training (through short courses 
and in-service education) that would enable them to fulfill the 
objectives collectively that had been earlier assigned to the sociolo- 
gist. Thus training and new experiences were sought and engaged in**- 
ultlmately by nine of the technicians. The training was provided 
through SUDAM (development agency for the Amazon), In Rio, and by 
on-the-job self-instruction. A variety of specialists was created 
by this process. These were specialists who already knew the job 
of the general ist (the technician), already knew the communities and 
the region, and could readily find use for their new skills and 
knowledge in their own work and In the work of their colleagues. 
Subsequent evaluation Indicated the achievement of the objectives. 

In a region where there Is a shortage of highly trained 
specialists who also have practical skills In applying their training, 
the question about strategy for staff expansion Is particularly diffi- 
cult. Whereas the logic of this case argued for hiring of a specialist 
in order to accomplish the objectives sooner, evaluation after the first 
experience showed that the time required for Induction of the new 
specialist was much greater than had been planned. Thus there was a 
serious discrepancy between the Intended outcomes and the actual out- 
comes . Because of PASE's tradition for basing decisions on evaluation, 
the mistake was not repeated. At the second decision-point, the 
alternative decision was made. Thus, In this case, an informal 
process of review, evaluation, and planning made use of a descriptive 
data gathering procedure to allow evaluation of accomplishment against 
intention. Because alternative procedures had been previously 
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identified and considered) tlie organization was not iimlted to the 
more common expedient of "if at first you don't succeed, try, try 
again." 

Example 3? Helping Communities Make 
Decisions Based on Evaluation 

After three years of community development activity In an 
Impoverished suburb of a port city in northern Brazil, a wide variety 
of related projects were on-going. Paving projects, small land 
reclamation projects, community enterprises, short-courses, mothers' 
clubs, water filtration In homes, and so forth. During one of the 
quarterly on-site evaluation sessions, the FASE technicians and 
specialists along with the leaders of the community participants came 
to a point of realization that all these many activities were rather 
superficial; even though the Individual projects were related to real 
needs and were relatively successful In and of themselves, they were 
unable to affect more serious, more basic problems and Issues that 
tended to hold down the community. (Such "moments of realization" 
have been commonly reported by FASE technicians and by other similarly 
engaged In community development.) At this session three problems were 
identified as basic: water control (the suburb Is set on the shallow 
marshes at the edge of a tributary to a major river rather prone to 
flooding), education, and employment. These three seemed so large 
as to defy efforts to deal with them, but through the insights and 
self-realization gained through successes on smaller, more manageable 
activities, the people of the community were able to evaluate their 
true condition and to begin consideration of these more basic 
problems. !>tudy commissions were established within the community. 
Three activities were undertaken by the commissions: collecting more 
information about the realities of each of the problems, considering 
alternative ideas about solving each problem, and establishing con- 
tacts with appropriate prefecture agencies. Thus was begun a series 
of baste problem-solving exercises wherein the stake was human life and 
welfare, and the hope was in the validity of an evaluation, decision- 
making, and re-evaluation model of planning activity. 
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Options identified in reference to tlie water problem are still 
being compiled and analyzed, fhougli tlie prefecture has provided 
temporary forms of assistance. The two major options seen in reference 
to the education of children are (1) persuasion of the government to 
provide this community a school building, equipment and teachers, and 
(2) building the school as a self-help activity. Although the 
decision has not been made, the commission has come to realize that 
the latter alternative leaves unresolved the problem of the costs of 
maintaining the school. The commission on the employment problem has 
undertaken with FASE to contract for a team of analysts to make a 
survey of the employment patterns within the community (employment, 
unemployment, reasons ^or unemployment, abilities of the unemployed, 
etc.). This survey will be interpreted In light of a subsequent 
study of the market and employment characteristics and potentialities 
of Be I em. 

Since FASE uses evaluation In Its own organizational decision- 
making. It Is In a good position to help communities also to do so. 
Unlike the fabled professor who says, "Do as I say, not as I do," 
FASE technicians are themselves participants In organizational 
decision-making based on evaluation. Thus they do and they say . 
Their message and their medium are highly consistent. Such an 
experiential background is highly desirable if effective use is to 
be made of an expanded evaluation process. 

The major goal of our work with FASE was the development of an 
Integrated system of evaluation. Because of PASE's substantial 
tradition and history of linkage between Informal evaluation and pro- 
grammatic change, and because of the recent establishment of an 
evaluation group within the central office of FASE, the directorate 
of FASE and representatives of the University agreed that circumstances 
were right for building a comprehensive evaluation plan. This plan 
was to have several Important characteristics: It would be focused 
on formative evaluation; it would stimulate evaluative procedures at 
the regional and local level (rather than being exclusively a function 
of the central administration. It would encourage communication between 
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the central personnel, especially the technical special Ists — Including 
the evaluation group— and the staff operating In the field, and It 
would provide for the orderly building, refining and revising of the 
theoretical framework and practices of FASE's operations. 

The achievement of objectives toward this goal began long 
before the direct participation from Nort|i America. The development 
of a quarterly report procedure through which technicians In the 
regional units were to make Input to the evaluation group was the 
first operational step that led to a coordinated system of evaluation. 
Unfortunately, as Is usually the case with a comprehensive Instrument 
that asks many detailed questions, the resistance of those who were to 
respond to the quarterly report was overwhelming. The original 
quarterly systems as developed by the FASE evaluation group was 
actually used by only several persons. It was realized that the 
technicians In the field and the regional coordinators would need to 
be more substantially Involved In the evaluation system--probably 
involved In its design and able to see what It would do to help them 
be more effective In their work. It was discovered that the structured 
evaluative activities were not nearly so well coordinated with each 
other as had been assumed. Each of the three major on-going evalua- 
tive activities had been undertaken for a different purpose, each had 
a different methodology; and to some extent, each was based on a 
different set of assumptions about the significance of FASE as a 
community development agency. 

The evaluation of training procedures In a sample of 10 or 20 
sites had been obligated as a condition of a grant from a foundation; 
how Its findings would be integrated into the operational procedures 
was not clear. The anthropological study of impact in two communities 
was conceived as a separate activity to provide insight into FASE's 
Impact on community infrastructure. The quarterly report , to be filed 
with reference to a convenience sample of communities where programs 
are underway was evidence of an anxiety In the main office of FASE 
to secure more evidences about activities In the field. Thus each of 
these three promised no external validity, no general izabtl tty to 
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FASE's work as a whole, and no strong promise of conversions Into a 
total system of evaluation. Worse yet, none of the three was pre- 
cisely focused on any particular management or design Issues that 
are under specific scrutiny. The probability of deriving. any basis 
for significant alteration of FASE's concept of community development, 
appropriate methodology or worthy outcome objectives seemed low. 
Perhaps the anthropological study of two communities might provide 
more useful data than all the rest, but their meanlng--lf generalized 
beyond the Immediate communltles--would demand Insight and care of 
the highest order on the part of FASE's central planners. 

An Evaluation Plan for f ASE 
Upon undertaking the first steps toward the development of an 
evaluation program, the FASE leadership people observed (without sug- 
gestion from the consultant) that a statement of the theory underlying 
their program was needed. Program descriptions are readily available, 
well documenting the way FASE programs are carried out, but nowhere 
does a comprehensive rationale statement exist. Like many another 
community development project, the concept and operating theories 
exist In the minds of the leaders and the technicians. They say, 
likely with much truth, that experience has shaped and reshaped tiielr 
thinking about how to do the Job-- Indeed, what the Job J_s! 

Conversations with the FASE people suggest that in their 
minds Is the residue of an earlier "assistance" model. Occasionally 
the conversation mentions "help them with their problems," "give 
them what they need," "show them their situation," and the like. 
Almost always, these are caught In mid-speech and altered to reflect a 
more developmental view of the problem. The experienced leadership 
people seem thoroughly attuned to the view that people who lack vision 
lack motivation. They both talk In terms of the need to begin by 
helping people see themselves and their situation more clearly. 

They talk In terms of changing people's attitudes through 
altering the "psychic reasons" underlying the attitude. They see the 
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possibility that people's experiences (behaviors and resultant rewards) 
may be the origin of most of the "psychic reasons," To what extent can 
the theoretical view of the problem and Its solution be kept out of the 
evaluation design? Should It be kept out? And If It shouldn't or 
can't be, how can safeguards be erected against the Imposing of pre- 
conceptions that obviate new and creative solutions? 

Two evaluative frameworks are apparent? first, FASE as a whole 
development procedure and Investment of resources demands a macro 
view of evaluation. How well Is FASE achieving Its stated objectives^ 
What are Its consequences In comparison to Its Intentions and Its 
promises? The second framework can be related to each of the Indi- 
vidual project activities within FASE's set of activities. To what 
extent Is each project achieving Its promises? How well does each 

y 

project compare with other FASE projects, present and past? Wh:»t are 
the peculiar variables or conditions that make It more or less 
successful than the norm? 

With reference to the macro framework of evaluation, the baste 
problem Is lack of standards or outside bases of comparison. With 
what can FASE be compared? Another difficult problem concerns the 
difficulty of determining a criterion or even a measurement concept 
to apply to the product . How does one quantify changes in human 
dignity and self-esteem? How Indeed, among people who cannot be pre- 
tested and must be post-tested In terms of highly subjective 
Indicators! 

With reference to the micro framework (evaluation, project by 
project by project) Is anything more baste than the assumption of 
differences in precedent conditions existing in each project site? 
How can mtcroevaluattons assure that the pre-testing or other pre- 
descriptlon recognizes the probably important conditions at the 
beginning of each project? One of the important issues here Is the 
Inclusion of certain evaluative procedures as Integral parts of the 
treatment conditions themselves. For example, studies of the reality 
of preconditions (antecedents) are also Included as part of the 
Intended treatment. 
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BEST COPY AVAILABLE 

Tlie mode) fo))ow)ng suggests the basic data needed for the 
evd)uat)ons.«'« 



INTENTiONS 
Preconditions 



Antecedents (what we think 
things and target peop)e 
and their situations are 
)il<e) (our view of the need 
and the potentia) ities) . 



De) ivery of Treatment 



Interventions (what we 
intend to do to affect the 
situations and the target 
peopie) (our design). 



Consequences 



Outcomes (which we intend 
to have happen because of 
our interventions) (our 
view of the desirabie 
product) . 



ACTUALITY (Empirica) Rea)ity) 



Antecedents ', (what the 
target peop)e and their 
situations are rea ) ) y 
)ike. 



Interventions (what we 
actually do that affects 
the situation or the 
target peop)e. 



Outcomes (what rea))y 
happens because of our 
interventions) . 



Figure 5.— The Six Major Ce))s of Information Needed for 
Comprehensive Evaluation. 



Evaluation^ in the older "scientific" models» was based 
primarily on measurement and assessment of outcomes. The evaluator's 
efforts were Judged worthy if he was able to provide an objective 
assessment of the consequences of an educational endeavor In light of 

Adapted from Robert E. Stake, 1 967. 
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either the objectives originally specified for the program or some 
quantified description of the need toward which the program was 
directed. The major flaw In such an approach Is Its Inability to do 
more than provide data on the degree of successful achievement of 
specific objectives; and, Inevitably, lose sight of the other outcomes 
and the meaning of the situation as a whole. 



Guidelines for Comprehensive Evaluation 
The first period of consultation and training resulted In a 
plan for the comprehensive evaluation. Following are excerpts from 
the report. of that series of conferences. 



Preface ; 

Community development Is one of the most complex forms of 
nonformal education. Every situation Is different; the 
learners are Intact groups (though usually more like non- 
cohesive clusters at the beginning); the goals and objectives 
of the learning processes depend to a great extent on the 
learners' own views of their needs and capabilities; the 
procedures for working with a particular community must be 
largely created for each situation; and the assessment of 
change must rely on remote and unreliable Indicators. 

Into this unwieldly mass, educational evalua tors rarely 
venture. There are no standardized tests, no proven 
Indicators, no reliable pretested methods or Instructional 
materials. Discovery Is as Important as evaluation, and 
when evaluation competes with discovery or when evaluation 
Inhibits discovery, evaluation Is not helpful. Thus the 
task Is to design evaluation procedures that will Increase 
discovery and stimulate creativity. Such evaluation procedures 
must. In the final analysis, be created by the people who will 
use them. Their sensitivities, sensibilities, awareness and 
insights must be the basis of deciding what factors should be 
evaluated, where to get the data, how much credibility the 
sources have, etc. 

Observations and Suggestions } 

1. An evaluation system is needed. There are good 
evidences of uses of evaluation In the decision-making and 
continuous improvement of FASE. At this time when several 
large evaluations are being planned and carried out, the 
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time is perfect for designing a comprehensive system. If it 
is not designed and put irco effect, the various evaluation 
efforts may become scattered, each tal<ing a somewhat dif- 
ferent direction and thus making theory development even more 
difficult in the future. 

2. The FASE operations are very complex. They are, 
altogether, too diversified and widely scattered to evaluate 
in comprehensive and reliable ways as a macro-system. 

3. For now, the evaluation system can be usefully built 
on a set of micro-level reportings, discussed interactively 
at the regional level, assessed and evaluated at the national 
level, providing the basis for practical feedback to the 
regional technical team level. Since such a system is easily 
biased by "voluntary" reportings or by convenience samples, a 
specific plan Is needed to represent a particular variety of 
programs and projects (to be reported from each region and in 
the same way from each region). The minimum of such 
reportings would seem to be the following: 

a. An activity representing the best of on-going 
comprehensive programs In the region*, 

b. An activity In which significant problems have 
been encountered; and 

c. An activity In which the outer edges of confidence 
are being expanded and tested. 

k. The largest meaningful macro-level of evaluation is 
probal>ly the regional level. It should someday be possible 
to generate data that will allow assessment of one region in 
comparison with another. (We do not suggest this as an early 
goal for the evaluation system, because there is not enough 
experience yet with any system of key indicators.) 

* 5. The national evaluation group should conduct its 
operations in such a way as to be a worthy model for the 
evaluation and refinement activities of the Regional Coordinators. 
We know that examples and models of behavior in real life are 
one of the more effective dissemination procedures. The way of 
professional life in which evaluation is used as a basis for 
continuous improvement is already characteristic of much of 
FASE's operation; this characteristic should be preserved and 
extended. 

6. A vital part of the evaluation system is the develop- 
ment of the theory and operational principles that the organiza- 
tion is developing. Evaluation and theory-development must be 
carried out together. 
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7. Theory development wlj) require "Inputs" from the 
evaluations, but It must start with something. (You can't 
make "Inputs" to something that doesn't exist!) As a significant 
step toward theory development a "Manual of Theory and Practice 
In FASE" could be written. Surely many of the national-level 
technical teams and the Regional Coordinators would have valuable 
statements to give to this compilation. Work could begin on 
writing this almost Immediately. 



General Objectives of the 
Evaluation System 

a. Theory (testing and refinement of) 

b. Describing processes and procedures as they develop; "* 
Assessing accomplishment 

c. Feedback (cycles of Information to technicians, 
coordinators, specialists, and administrators) 



I • "Pioneer Project" Reporting 

Def tnl tlon ; Specific Information about a project or 
program that Is new, experimental and Important. 

2. Objectives: 

2.1. Theory ; - Developing new Information. 

- Testing procedures In new situations. 

2.2. Describing and Assessing ; 

- Describing new methodology and techniques. 

- Expanding the typology of community 

characteristics (groups) and needs. 

- Assessing the results of Interventions. 

2.3. Feedback : 

- Discussions, analysis and suggestions 

of all the teams In the region. 

- Descriptions to other interested regions. 
* Descriptions to national specialists. 

- Responses to originators to increase 

the awareness of the technicians. 
" Creating new instruments, procedures, 
and techniques. 
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3. Characteristics (Criteria) ; 

3.1. Experimental applications of theory to particular 
communities. 

3.2. New procedure or new situation in which procedure 
has not formerly been applied. 

3.3. Potentiality of making discoveries that can be 
applied in other situations. 

3.i». Importance can be anticipated for more than one 
region. 

i». Results Expected ; 

A.l. Basis for evaluating FASE's probable success in the 
particular kind of situation or procedure. 

^.2. Basis for evaluating success of the intervention. 

^.3. Providing indications of trends 

- Intensity f participations In social process 

- Diversity of social groups reached 

- Depth of community problems treated 

- Other Important Indicators of basic community 

awareness. 



1 1 . "Key Project" Reporting 

1. Definition ; Specific Information about a program within a 
particular community, viewed as an ecology, with reference 
to one project that best represents the key to development 
within that community. 

2. ObJ ectlves ; 

2.1. Theory; - Identify Important elements for the 

educational process 

- verification and reconfirmation of theory 

- better understanding of relationships 

among parts of a total program. 

2.2. Describing and Assessing ; 

- relationships among parts of a program 

- acceptance, rejection. Involvement, 

dissemination within the groups 

- relate the objectives of the whole 

program with the diagnostic view of 
the community and the region. 
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2'3. Feedback ? - provide the regional team with a basis 

for discussion about program Improve* 
ment 

- provide regional and national specialist 

with a basis for providing services 

- provide a basis for recommendations at 

regional and national levels about 
^ changes in focus or emphasis In the 

program. 

3. Characteristics (Criteria) ; 

3.1. A project or other specific aspect of FASE worl< 
with one community which is thought to be the vital 
or crucial center of focus for the program. 

3.2. Most other aspects of the program are influenced by 
(or have influence on) this "key project". 

3«3« Is within the most comprehensive program of the 
region. 

3.4. Is seen as exemplary in qualitative concern for 
procedures, results, and theoretical basis. 

k» Results Expected ; 

4.1. Provide basis for evaluating inter-relation of 
activities, technical services, etc. 

4.2. Provide basis for evaluating effectiveness of 
planning. 

4.3. Provide indicators of vital factors. 

- Degree of community participation in selection, 

planning, execution 

- Degree of depth of the program 

' Degree of community organization. 



"Problem Case" Reporting 

I. Definition ; Specific Information about one project or 
program which has been distinctly unsuccessful so far 
or a case of failure. 

2« Objectives ; 

2.1. Theory; - identify Inadequacy of theory 

- identify flaw (error) in theory 
•* identify misappi icatlon in theory 
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- Identify gaps or openings in theory 

- identify (define) limits of the 

effectiveness of the organization. 

2.2. Describing and Assessing ; 

- describe discrepancies between 

expectations and actualities 

(1) pre-conditions 

(2) procedure 

(3) consequences 

2«3' feedback ; - provide stimulus for regional team 

to evaluate itself 

- provide national specialists a basis 

for giving needed advice and services 

- modify procedures and methodology 

- modify technical assistance 

- modify criteria for selections of 

groups and areas 

- modify scheme Instruments for studying 

- modify social real ity 

Characteristics (Criteria) ; 

3.1. It Is a project or activity which has been 
considered by the regional team. 

3.2. Project or activity should have been going on 
for at least one year. 

3.3. Project or activity had been planned with 
definite objectives and procedures. 

^.k. Project or activity was not an Isolated or 
unrelated activity. 

3.5. Project or activity which has encountered 
Insurmountable difficulties. 

Expected Results ; 

4.1. Stimulus for regional team to evaluate Its worl< 
In specific terms. 

4.2. Basis for providing technical assistance by the 
national team. 

4.3. Procedure for discovering the cause of failure 
and difficulty. 
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Basis for proposing Improved procedures, 
'♦.S. Reduced probability of repeating failures. 



INTENTIONS 



ACTUALITIES 



Expected or assumed 
I characteristics of the ■ 
\ situation 

A (Pre-conditions) 0(M) 




The Basis of Formative Evaluation ; 

Questions for assessment during planning and replanning: 

1 . Questions of Relationship (R) 

?Rj Are the objectives appropriate for the situation? 

?R2 Is the plan realistic and appropriate , considering what 
are assumed to be the characteristics of the situation? 

?R. Is the plan realistic and appropriate , considering what 
outcomes and results are desired? 



00246 



239 



2. Questions of Congruence (C) 

?C, Is the situation actually the same as had been assumed? 
' (Also see ?M^) 

?C, Is the Intervention or treatment being delivered or 
* provided in the way and to the extent planned? Should 
it be? 

?C- Are the outcomes the same as the objectives? Are the 
^ outcomes Inadequate? Are they appropriate? Are results 
occurring that are not intended or desired? (Also see 

'«2> 



3. Questions of Modification (M) 

?M, On the basis of what is learned about the situation 
' from actual experience, vj/hat changes in the plan 
should be made? 

?M2 On the basis of what actually happens, what changes 
in the plan should be made? 



The Basis of Summatlve Evaluation ; 
Questions for assessment of outcomes: 
Questions of Summatlve Evidence (S) 

?S, What changes in the situation have occurred during the 
' time of the intervention or treatment? Are these 
changes satisfactory? 

?S5 Is there evidence that the changes can be attributed 
to the treatment rather than to some other factor? 

?S, Do the changes conform to the planned objectives? 
^ (Also see ?C,) Is this satisfactory? 



Modes of Data-Gathering 

(See code-letters In lower right corner of each box.) 

Ot Descriptive data— emphasis on full verbal and graphic 
representat ton. 
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M: Heasurements— quantitative data on vita) Indicators 
(measurement data typically supplements to descriptive 
data) . 

P/P: Pre- and post- with reference to eltiier description of 
measurement data* the need to get data from two (2) or 
more points In time In-order to discover change. 



Value Concepts : 

Each of the truly evaluative questions In the list above contains 
an underlined word. These words show that a value concept must 
be brought into consideration In order to place a value on the 
assessment. "Good" or "bad," satisfactory or unsatisfactory are 
value judgments, not assessments. The assessment Is only a 
comparison of two measurements or two descriptions; evaluation 
is a value judgment about the quality of the meaning of an 
assessment. 



Subsequently, the evaluation group developed operational forms 
to Implement this plan. Through their experiences and trial uses of 
several of the procedures, changes were made In some particulars. The 
major particulars of the report of the evaluation group after their 
operational work follows: 

Four ih) elements seem to be essen>^^lal within the evaluation: 

A. Training purposes 

6. Training contents 

C. Training resources 

0. Training results. 
Each element Is represented by l<ey Indicators. 
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INDICATORS 



L. 

0.1. Phenomena that determine the purposes of the training 

0.1.1 Diagnosis of educative intervention in terms of the needs 
in the area . 

0.1.2 Diagnosis of educative intervention in terms of needs in 
community . 

0.1.3 Concept of meeting needs that underlies the training. 

0.2 Decision process that led to the training 

0.2. 1 Decision origin 

0.2.2 Standards that directed selection of participants 

0.2.3 Material resources mob 1 1 izat ion 

0.2.^ Techniques resources mobi 1 Izat Ion 

0.2.5 Financial resources mobi 1 izat ion 



B TRAINING CONTENT 

0. 1 . Nature of content 
0.1.1 Information specifics 
0.1.2 Sources of information 
0.1.3 Quantity of Information 
0.1.4 Group's product 



0.2. Psycho-pedagogical factors 

0.2.1 Didactics or approach medium 

0.2.2 Group's productivity 

0.2.3 Group's Integration process 

0.2.4 Definition of functions and/or responsibilities 
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INDICATORS 

C TRAINING RESOURCES 

0.1. Resources of the Environment 

0.1.1 Local conditions and Influences 

0.1.2 Temporal conditions and influences 

0.2. Material resources 

0.2.1 Quantity and quality of availability material 

0.3* Human resources 

0.3*1 Participants, quantity 

0.3*2 Social /economical /cultural characteristics of participants 

0.4. Technique for use of resources 

0.4.1 Coordination and curriculum 

0.4.2 Teachers approach to capacltatlon 

0.4.3 Materials and their Improvement 

0.4.4 Control of execution 

0.4.5 Administrative organization 

D TRAINING RESULTS 

O4I Immediate results 

0. 1 . 1 Information gains 

0.1.2 Instrumental and sl<l11 gains 

0.1.3 Worl< plans produced 

0.2. Difference between training Intentions and actualities 

0.2. 1 Origins of fal lure 

0.2.2 Origins of failure 

0.2.3 Influence of unforeseen agents 

0.3* Pursuant results (transfer) 

0.3*1 Group's level of achievement In followup of the training 

0.3*2 Population directly reached 

0*3*3 Evidence of use of the educative intervention 
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INDICATORS 

0 TRAINING RESULTS (Cont.) 

0.^. Differences between anticipated and actual activities 
0.^.1 Origins of unsuccessful activities 
0.^.2 Origins of successful activities 
0.^.3 Influence of unforeseen agents 



0.5 Induced effects 

Evaluative Standards 

In Relation to the 
Training Purposes ; 

- Was there serious discrepancy between the general purposes of 
the training and the purposes of the educative Intervention 
in the area? 

- Was there serious discrepancy between the general purposes of 
the training and the aims of the educative intervention In 
the community? 

« Was there close relationship between the particular purposes 
of the training and the community need that caused the 
training's origin? 

" Did the group take part in the search for resources for the 
training? 

- Did the community participate in the study of Its resources? 

In Relation to the 
Training Content ; " 

« Did the content correspond to the training purposes? 

- Was the information sufficient to satisfy the needs of the 
group being trained? 
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- Did the intellectual product of tlie group add new elements 
to t lie available information? 

- Were tlie Intellectual, educational and affective character- 
istics of the people being trained tal<en Into consideration in 
the handling of Information? 

- Was the productivity of the group enhanced by the approach 
to content? 

- In what ways was the relation between Individual apprentlceshl 
and group Integration considered? 

- Old the structure of training functions contribute to the 
group's autonomy and the tasl<'s fulfillment? 

In Relation to the 
Training Resources" ; 

. - Were the mobilized material resources sufficient to achieve 
the alms? 

- Old the environment conditions contribute to reaching the 
purposes of the training? 

- What effects resulted from the participants' homogeneity of 
heterogeneity? 

" Old the coordination and teachers' capability level match 
the group expectation and the demands of the educational 
intervention? 

- Did the use of didactic material ease the apprenticeship 
process of the group? 

- Was use made of feedback from the evaluation done during 
the training? 

In Relation to the 
Training Results ; 

" Did the group elaborate work plans by the end of the training 
In order to assure the continuity of educative Intervention? 

- Did the final evaluation of the training Indicate Its success 
or failure (achievement or non-achievement of the goals of the 
program)? 
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Instrument development and procedures recommendations were 
subsequently developed regarding the Instrumentation for this system 
of comprehensive evaluation for FASE* Details of those recommendations 
fol low: 



"Pioneer Project" Reporting 

Instruments Needed 

1. Nomination form: 

Purpose: To select appropriate Pioneer Project 

Procedure: a. Regional Coordinator suggests one project and 

gives brief description. 

b. National Evaluation Team decides if suggested 
project meets criteria for Pioneer Project 

c. If so National Evaluation Team sends copy to 
each other Regional Coordinator 

d. Each Regional Coordinator decides if he is 
interested in having information about the 
suggested project as it develops. 

e. >'' If one or more Regional Coordinator says "yes," 

the project is declared to be a Pioneer Project. 

f. * If not) Regional Coordinator is asked to suggest 

a different project. 

2. Initial Report (Description of Pioneer Project): 

Purpose: To describe the Pioneer Project in detail and to 
stimulate a feedbacl< process at regional and 
national levels. 

Procedure: a. Technical team actually working in the Pioneer 

Project fills out the Initial Report form. 

b. During next monthly regional meeting entire 
regional team discusses the Report, discusses 
the Pioneer Project and makes suggestions. 

c. Form is then sent to National Evaluation Group 
and to other regional offices. 

d. National evaluation group makes analysts, 
informs technical specialists of needs revealed, 
prepares critique. 

e. Critique is sent to Regional Coordinator and 
discussed with Pioneer Project team. 



Same procedure be use^ for "Key Project" Reporting. 
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3. P rogress Report of Pioneer Project 

Purposes: To provide additional Information on the deveiopment , 
problems, accompi isliments and experiences of tlie 
Pioneer Project to continue the feedback process at 
regional and national levels. 

Procedure: a. Wlien any significant cliange or new step In the 

Pioneer Project occurs » the project team fills 
out a Progress Report form. 

b. At the next monthly meeting of the regional 
team the report will be presented and discussed 
by the entire regional team. 

c. The Progress Report is then sent to the National 
evaluators and to the other regions. 

d. The National Evaluation Group makes analysis, 
notes needs, etc. 

e. A critique is sent to the Regional Coordinator 
for discussion by the project team. 



"Problems and Failures" Reporting 

Instruments Needed 

I. Problem Report Form 

Purposes: To provide Information about difficulties so that 
technical help can be provided; 

To stimulate a feedback procedure within the regional 
team and at the national level; 

To identify flaws in the operating procedures. 

Procedure: ' a. At' 6 month intervals, the Regional Coordinator is 

to give one day of the monthly meeting sessions 
to a review (with the entire regional team) of 
the most serious problems in particular projects. 

b. One of these problem cases is to be selected 
for reporting. 

c. The technical team for that project wMI prepare 
the report with the Regional Coordinator. 

d. The report is sent to the National Evaluation Team 
for analysis critique. Specialists are advised 

of needs. 

e. A commentary is sent to the r« i tonal Coordinator 
for discussion with the technical team* 
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f, The technical team Is to attempt to apply the 
advice given and report to the National 
Evaluation Team on the "Follow-up Form." 

2. Follow-up Form (Problems) 

Purpose: To provide feedback to the National Evaluation Team 
regarding the usefulness of the advice given and the 
consequences of having put It Into effect. 

Procedure*, a, A blank copy of this form (matrix) Is sent to the 
Regional Coordinator accompanying the advice and 
comments on the Problems Report. 

b. After two months or less, the technicians Involved 
In the Problem project are to fill out the 

Fol low-up Form. 

c. The Follow-up Form, as prepared by the technicians 
is to be discussed by the whole regional team. 

d. The Follow-up Form Is then sent to the National 
Team. 

e. If further advice and comments are needed, the 
whole procedure can be repeated. 

3. Failures Report Form 

Purpose: To provide Information about the difficulties which have 
caused an activity to be stopped; 

To provide basis for making connections In the theory 
and practice of FASE operations within such situations; 

To stimulate discussions and feedback at the Regional 
and National level about activities In which serious 
difficulties have been encountered. 

Procedures: a. At six month intervals, the Regional Coordinator 

may file a "Failure" report instead of a "Problems" 
report if his regional team would prefer. 

b. The procedure for the "Problems" report Is 
fol lowed. 
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efforts may be. The very life of FASE depends on Its rendering 
recognizable valuable services. In fact, considering the level of 
dedication of so many of Its leaders and technicians, It Is hard to 
Imagine any perpetuity of the organization except as It continues to 
prove Itself to be a workable vehicle for true community development. 

Technical Recommendations 
Field experiences In consultation to non-formal education 
have led to several conclusions about the state of the applied art of 
education: 

1. A general awareness of the Importance of evaluation Is 
common among leadership people in non-formal education. 

2. There is more willingness than available sl<lll in 
designing and carrying out evaluations. 

3* Evaluations typically lack adequate focus on the 
factors that are most likely to relate to possible 
program Improvements. 

In order to provide some assistance in light of these 
realities, this section of the chapter contains a series of suggestions. 
Some of the more common weaknesses in typical designs are identified 
and suggestions for improvement are offered. 

Evaluation for non-formal education has two basic purposes. 
First, evaluation can provide a basis for making modifications and 
improvements in the learning exercise. The second set of purposes for 
which evaluation is done is the more classical— determining how 
effective the learning experiences are. 

What to Evaluate? 

Evaluations of a non-formal educational activity should 
give account of three aspects of the instructional materials delivery 
systems and learner's experiences. First, as would be the case with 
any educational evaluation, there must be a concern for what has been 
learned. Learning is typically evialuated in terms of the change in the 
learner which can be credited to the given instructional experience. 
This first aspect of evaluation is concerned with the gain or changes 



002^6 



in content knowledge (and all other significant aspects of iearning) 
wliicli can be seen as a consequence of the particular program. A 
taxonomic approach to learn ing--concern for the specific l<inds and 
levels of cognitive, affective and psychomotor learnings-"is usually 
required. The second aspect of a non-formal educational activity or 
program that should be considered for evaluation is motivation. 
Motivation, in this sense, is concerned with the degree to which an 
instructional experience relates to the interest and is able to hold 
the interest of the learner. The third aspect of a non-formal 
learning experience that must be evaluated is the crucial concern for 
transfer of learning. Although much of formal education evades the 
test of demonstrated positive transfer of learning to the assumed 
equivalent tasks of life, concern for transfer is often the primary 
reason for a non-formal educational activity or program. Thus it is 
incumbent upon designers, and administrators of non-formal education 
to be concerned with transfer of learning when they are planning an 
evaluation program. 

Evaluating Learning 

Although it is more common to evaluate learning by giving a 
test at the end of a learning experience, any valid claims about 
change in the learners must be based on comparisons of data from 
tests or observations at the end of the experience and comparable 
data from the beginning. Thus a pretest/post-test approach to evaluat- 
ing the learning increment is indicated. There should be a high degree 
of consistency between the stated objectives for the experience and 
the items to be examined in the pre/ post testing routine. (Typically, 
in a well-designed instructional program it is possible to infer the 
objectives by examining the tests or to project the tests by examining 
the statement of objectives.) 

One of the commonly overlooked concerns in evaluation of gains 
in learning is the possibility that learners may be regressing In some 
important area while they are apparently gaining on the intended 
learning. The classical example in formal education is the tendency 
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of students to grow to dislike arithmetic even though they may be 
gaining computational si^iUs through continued exposure to arithmetic 
instruction* A comprehensive evaluation of learning should give some 
attention to the sorts of "bad learnings" or unintended accomplishments 
that may accompany a learning experience* This can be accomplished by 
providing for a monitoring (in the pre/post testing) of crucial con- 
comitant learnings that should not be allowed to regress or develop 
in the wrong direction as a byproduct of the instructional experience. 

Evaluating Motivation 

Evaluating motivation can be accomplished best by observing 
learners of different sorts while they are engaged In a learning 
experience. Often the observer can pay attention to the levels of 
interest and the points in the game or simulation at which interest 
lags or the students become disengaged from one another or from the 
experience itself. It is helpful to make a chart, blocl<ing off on 
the horizontal the various phases of the instructional experience, and 
to marl< a series of points representing highness and lowness of 
interest at many points in time. Thus it is possible to derive a 
relatively reliable picture of the rising and falling of apparent 
interest during each phase of the experience. A simple graph can be 
produced using several colored pencils to represent the interest level 
of several students under observation. Another commonly used technique 
for evaluating motivation is to ask participants to write their level 
of interest or to respond to questions that ask specifically about 
their interests in, as well as enjoyment and satisfaction derived 
from, various parts of the Instructional exercise, it has been our 
experience that. In general, students are able to add significant 
Information through this sort of questionnaire or open-ended response 
to questions about motivation, interest and enjoyment. But such 
information is not a substitute for direct observation of a group of 
students engaged in the experience under conditions for which it was 
designed. 
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Evaluating Transfer of learning 

It may seem unfair to Insist that non-formal education be 
concerned with transferability. Certainly formal education Is rarely 
called to account for transferability of learning from the school 
environment to the real world. Nevertheless, It has been accepted 
that non-formal education's very justification lies in its high degree 
of 1 ife-relatedness. So a concern for evaluating the transfer of 
learning is required. If non-formal education Is used In order to 
Increase the relevancy of learning to the real world, designers and 
program administrators should determine that. In fact, such a claim 
is valid. 

The most valid tests of transfer of learning would necessarily 
be done in longitudinal studies. Testing the learners as they 
encounter the real situation for which the instructional experiences 
had supposedly trained them would be required. But since the moment 
of encounter with the real world equivalent may be months or years 
later, a longitudinal approach, while Ideal, may be impractical. (It 
is just this impractical 1 ty that has been used historically to exempt 
the school from answering the tough questions about the:^ relevancy and 
the transferability of learnings gained within formal education.) 
Thus a second approach can be used when longitudinal studies are 
Impractical; simulation is designed so as to test the application of 
skills gained in the learning experience. In other words, the transfer 
of learning gained In a particular instructional experience is assessed 
in terms of the degree to which the student can competently deal with 
problems in a new but related situation. Thus while some simulations 
have training as their primary purpose, others have as their primary 
purpose the evaluation of the learning from a previous experience. 

Distinctions Between Formative 
and Summative Evaluation 

With reference to the evaluation of learning (content 

acquisition), both formative and summative evaluation is indicated. 

Of primary concern during the development of or the refinement of an 
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instructional strategy or program is evaluation that indicates which 
of the learnings are being accomplished and which are not and what 
sorts of participants are learning and what sorts are not. Such 
Information should be made available from a formative evaluatlon so 
that designers can take steps to make corrections or adjustments as 
Indicated by the patterns of strengths and weaknesses in the learning 
experiences. From a summative point of view, evaluation of learning 
is necessary in order to establish the validity of the experiences or 
program in terms of its potentialities for achieving its claimed 
learning objectives. Whether or not to use a particular instructional 
experience again Is decided by summative evaluation. Summative 
evaluation Is also useful to determine what auxiliary experiences must 
be provided in order to broaden the learnings and to clear up the 
less well accomplished objectives. 

Summative evaluation, especially if derived at several different 
points during an experience, Is also useful as an Instructional Input 
to the learner. As the learner gets Information on the results of his 
actions and decisions he becomes more fully a party to the whole 
learning process, making changes and corrections as needed to more 
fully accomplish his own learning objectives. 

Most evaluation of motivation is done for formative purposes. 
Such evaluations are very helpful in the refinement of an instructional 
experience, assuming that the designer Is free to rebuild or redesign 
so as to keep the interest level higher. As a summative evaluation, 
indications of the observed motivation level of the experience can be 
useful In making decisions about whether or not to use It for 
particular groups. 

Evaluations of transfer of learning can serve both formative 
and summative purposes. For both they serve as the crucial Indicators 
of whether or dot the experience In Its present form will be Justified 
In terms of cost and time as the educational Intervention leading toward 
a certain competency in the real world. For the designer, this sort 
of information—usually derived from a research study of the relation- 
ship of learning acquired In the exercise of the learning demanded In 
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the real world—Is extremely useful In the redesign of a faulty 
learning experience. Data concerning the degree of transfer can also 
be used as a basis for making the d»-;!clslon about whether or not to use 
the experience. 

How to Evaluate? 

Evaluation demands both measurement and valuing . Measurement 
requires the use of a procedure to quantify—to provide an objective 
description. Valuing requires a procedure for assessing the objective 
description In terms of its worth— to allow the objective data to be 
related to some basis for determining value and significance. 

Most educational evaluation Is concerned with assessments 
(comparisons). Often the basic concern Is for assessment of the conse- 
quence of a particular educative procedure. Sometimes the comparison 
is between two (or more) educative procedures or experiences. But In 
any case, the evaluation is Incomplete until what Is Is related to 
what is desired or Intended. 

Scientific methods of analysis, description, and prediction 
mal<e their greatest contribution to educational development through 
the procedures of evaluation. Curriculum decisions are of two basic 
sorts: (1) the what , when and how, and (2) the wh^. Scientific 
methods of evaluation can provide considerable help with the former 
set of questions, but the help Is most useful within a context of 
values arising from the continued analysis of why— the reasons, the 
Intentions, the goals, and the beliefs about what Is important. 

Thus the application of scientific methods of data gathering and 
analysis are relatively easy to relate to the what , when and how 
questions. But evaluators must not stop here; there are ways to 
apply scientific Investigation procedures to the data underlying the 
wlv^ decisions as welK The major questions In this sector— the valuing 
sector— deal with who has the responsibility for setting goals, how 
well are the goals clarified and communicated, and how responsive 
the system is to the goals. 
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The following series of questions and problems indicates some- 
thing of the range of Issues to which any thorough evaluation must be 
related. A sequence is Implied In the list, but the particular 
situation in a particular evaluation project will usually demand 
alteration of this seqatsns-e. The major purpose of this list Is to 
make the evaluator mc»f« aware of the many factors that Impinge on an 
educational program, thus he can be more alert to the unchallenged 
assumptions and the Inquiry gaps that afflict any particular evaluation 
task that Is defined as less than thorough. 

First, consider the assumptions upon which the list Is built! 
evaluation of educational programs and services must !iave three 
functions? (1) Information gathering and assessment, <2) evaluation, 
and (3) planning. 

Information Gathering and 
Assessment 

Determining what data are needed and getting them Is an 
essential step. Logical though this statement Is, It Is amazing how 
often an educational assessment falls to gather data before pushing 
ahead Into passing Judgments before gathering the appropriate data! 
Many evaluations begin from a framework of given services (institutions 
and programs). This approach Is always destined to give a Isss-than- 
complete picture of learners and their needs. The framework or focus 
should be on the learners and the experiences more than on the 
services or program. 

Evaluation 

Determining what is important and weighing the status quo 
against identified values and aspl rations— Is the focal problem. 
Quantitative data are but one sort of Input j even more crucial are the 
data about values-'the inputs that provide a means for establishing 
the relationship between empiricism and human aspirations. 

Planning Is less classically a part of the evaluation process 
in education) but concern for improvement in education demands that 
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evaluation be designed so as to make direction 1inl<ages between 
evaluation and planning. Here is tlie ultimately important "so what?" 
dimension. Here is the essential justification for the whole inquiry. 
Assessment that concludes with the shelving of reports has little 
justification in a pragmatic era. 

I . Information Problems ; 

A. The target population as learners 

1 . Who are they? 

2. Where are They? 

3. »;hich of them are being reached by educational services? 
Which of them have needs that are not being met? 

5. What are their needs? 

B. The service programs 

1. What are the species of service programs actually or 
potentially available for this target population? 

2. What agencies currently have responsibility for each 
of the services? 

3. What articulation exists among the programs and 
Institutions? 

k. What changes (enlargements, reassignments, etc.) have 
taken place in the past decade, and what has been the 
rationale for each? 

C. The evident concept (the actualized concept) of education 
for the target population. (NOTEj Regardless of any 
official formal enunciation of a concept of education for 
this target population, a rer.ponslble data base must include 
an empirically deduced definition. The formal view and the 
Informal views expressed through practices and policies 

are often highly divergent.) 

1. What, in practice, constitutes being a member of the 
target population? 

2. What do they need? (How do they see their needs?) 

3. What can be done for them? (What do they want done?) 
^. What do we think we are able to do for them? 

5, How do we know when they are ready to progress from 
one service to another? 

6. What constitutes being an educated person? 



0()263 



256 



I I , Value Problems ! 

A. Interpretation of the needs of the target population 

1. What meaning Is derived from the descriptive data In 
I ,At above? 

2. What Is the political meaning drawn from I.B. In 
relation to I .A, , above? 

3. Whose opinions affect and constitute II.A.l and I LA. 2 
Immediately above? 

k. To what extent can a more clear picture of the 
status guo be derived? 

B. The aspiration and commitment of the establishment 

1. What Is the model of educational services to which the 
several voluntary and private agencies are willing to be 
committed? 

2. What Is the commitment of the public agencies? To 
what model of services? 

3. What are the differences between evident accomplishment 
(as assessed by all of the above) and the commitments? 

III. f^lanning Problems ; 

A. Deriving meaning from assessment 

1. Whose responsibility Is It to enunciate evaluative 
meaning? 

2. What changes are suggested by the evaluation? 

3. What model for future attainment can be drawn? 

k. What agencies and units will be charged with Implementing 
change toward the new model? 

B. Motivating change 

1. What agencies are authorized to motivate change? 

2. What communication processes can be used to stimulate 
the relevant segments of the public? 

3. What reward systems can be identified or defined for 
the new model? 

Evaluating Pilot Projects 

One way to start the evaluative process Is to establish a pilot 
program and submit It to careful evaluation. Experiences in cross- 
cultural instructional materials development suggest two sources of 
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essentia] data If one Is to Increase learning effectiveness: the 
continuing study of the target learners In terms of their social and 
psychological characteristics; and measurements of learning from the 
materials and resultant experiences. With reference to the first of 
these, there Is no substitute for continuous transactions with the 
target learners and for the anthropologists' sort of Insights Into 
what lies behind the overt behaviors and the fa9ade presented to the 
outsider. With reference to the second measurements and assessments 
are valuable to the extent that their meanings are reduced to workable 
and Increasingly precise guidelines for the subsequent productions of 
materials. In other words, If experience Is expected to teach anything, 
it should provSJe a basis for doing a better Job In the program than 
has been done In the pilot project. Evaluation should focus on the 
matter of what sorts of Instructional experiences achieve what learning 
gains , for what sorts of people . Under what sorts of Instructional 
conditions . The need to learn these answers Is so great that It Is 
worth the risk of disrupting the program to some extent In order to 
get the data! These questions must be answered; otherwise, the pilot 
project will be only a costly Investment in a handful of people. 

Evaluation In non- formal education should attend to the basic 
problem of non-formal educations helping the hopeless to find hope and 
somehow to reconstruct social systems In which such embryonic hope 
will not be dashed against the rocks of economic oppression. Until we 
are able to see whether or not a given educational program will do 
more than Increase the size of the oppressor-manipulator class and 
whether or not it can be effective among people of unrealized humanity, 
a pilot project has not done all that it should. These questions 
are perhaps more philosophical than scientific but evaluation Is 
concerned with values . What will people do with their new learning? 
Better themselves at the expense of others? This question, left 
unasked, has much to do with the decadence of Western education. 
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Chains of Changes 

Some non-fonnal education is concerned with highiy specific 
learning gains which can be measured in fairiy precise terms in 
reasonably short range; for example, Job sl^ills training, nutrition 
and health habits are usually appropriate for statement as behavioral 
objectives to be achieved directly by an instructional experience. 
Other non-formal education operations are concerned with longer-term 
"chains of changes" and with more abstract learning goals. This is 
especially true of community development education and the concommitant 
concerns for "conscientization" and enhancing of self-esteem. In such 
projects It is not defensible to specify ultimate objectives such as 
"the learner Is to participate voluntarily in activities that result 
in community change" and expect learning (behavior change) resulting 
from some short-term experience in a non-formal education activity. 

Chains of learning steps (changes) must be identified and 
evaluated, step by step. An example. In a non-formal education 
project in community development, these chains have been specified 
(Figures 6 and 7)« The charts following should be read from left to 
right, in the sense that the first box is to lead to the second box, 
which is to lead to the third, etc. Two points are made on this 
propos Ition: 

1. It is unreasonable to conceptualize the learning process 
for complex social functions without taking account of the inter- 
mediate functions (behaviors) between the seminar or Initiating 
experience and the ultimate outcome. 

2. A given experience may move a person toward a desired 
learning outcome without, in fact, producing the intended outcome. 
Such a move is "good" in the short view, but inadequate as a basis for 
judgment in the long view. 

Thus the issue is focused: should the evaluation of learning 
effectiveness be limited to Yl or should the whole scope (X^) be 
examined? Since X cannot be examined in a one-shot evaluation* 

t 

evaluation of X requires a series of inquiries, usually spaced over 
time t6 determine the consequences In terms of Yl, Y2, Y3, etc. Is 
there timeand interest tn doing this thoroughly, or will it be enough 
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to examine the effects of several key materials In terms of their Yl 
effects and perhaps add an examination Y2 effects for certain crucial 
materials or experiences, Evaluations of each Y outcome should be 
conducted In such a way as to, examine the relevance of these first 
and second-level outcomes to the uTtTmaTe object chain of 
behaviors. 

The Context of Experience 

For purists, the evaluation of an Instructional material or 
experience cannot be seen as valid If It is not considered In the 
actual context and conditions for Which It Is Intended. There Is, 
for example, no way to Infer that a Bolivian peasant will enjoy 
crossword puzzles simply because many middle-class Americans do. Or, 
In a less absurd Illustration, claims about the learning effectiveness 
of a particular procedure for certain peasants In the mountains cannot 
be generalized to peasants on the coast without re-verif Icatlon. 

On the other hand one can argue that this Is an Issue of degree. 
Since no two learners are exactly alike there can never be totally 
general Izable claims. The Issue Is how much Important difference Is 
there between two sets of target learners? But then we rarely can be 
sure what Is and what Isn't an Important difference! So, to play 
safe, good evaluation procedure calls for doing experimental work and 
deriving evaluative data from learners as near as possible like the 
target learners and In uses as near as possible like the Intended 
uses (Including facilitator/teacher style). 

It Is recommended that evaluation be done In the actual sites 
of the demonstration and dissemination projects whenever possible. 
And attention should be given to the other factors, environmental and 
Instructional, that surround the uses of the materials. 

A Warning About Specific 
Objectives 

In reference to specificity of objectives, non-formal education 
activities fall Into two categories: those with highly specific 
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objectives represented by relatively short-term changes of a visible 
sort, and those that are aimed toward more complex long-term remote and 
less visible goals. The first of these kinds of educational activity 
are relatively easy to evaluate. The second kind Is usually 
diff tcult--and sometimes Impossible to evaluate precisely. 

Evaluators tend to evaluate what Is easiest to evaluate. In 
fact, the quest for "scientific" evaluation tends to glorify those 
aspects of a program that are most easily measured, whether or not 
they are really the important factors In the program. 



Problems In Gathering Data 

Since many non-formal education programs are concerned with 
peasant populations, gathering data for an evaluation can be 
especially difficult. The difficulties arise from three sets of 
problems: 

Contamination . The most sensitive issue Is maintaining 
the integrity of an on-gotng operation while attempting 
to collect evaluative data. If observers or Interviewers 
are sent In, the relationships among the learners and the 
facilitator or teacher may be affected. In some cases, 
such an Intrusion Is made more serious by the cultural 
gap between the observer and the program participants or 
by well-meaning efforts of the observer to become a 
"participant" or to usurp the roles of the leader. 

2. Conceptual Level . If the purpose of evaluation Is 

understood at al I by the learners. It may be In simplistic 
terms. The data collectors may be seen as inspectors or 
as the embodiment of the whole authority structure that 
maintains the program. Thus those who think well of the 
program may behave unnaturally so as to create a "good 
impression." Or conversely, fear of the outsider may 
cause a complete breakdown of the program. 

3« Logistics . Since many programs are operated In remote 
and scattered locations, there Is a tendency to focus 
the evaluative efforts In the more convenient locations. 



262 



Observers as a Possible 
Disruption 

Virtually any good evaluation plan will Include the use of 
observers or Interviewers. Since the observer Is potentially a 
disruptive Influence In what may be a fragile or sensitive sTtuaflon, 
field workers In non-formal education tend to resent the Intrusions. 
Further, since outsiders constitute a diversion, a threat, or. In some 
cases, attention from them becomes a spurious reward, the situation 
nan be Influenced and, scientifically, contaminated. 

On the other hand, there seems to be a "straw man"? that 
an outsider, a properly trained person from a compatible cultural, 
background Is a significant disruptive factor. With training fisnd 
sensitivity to the more-or-less fragile dynamics of the learning 
situations same-culture observers can be Indlspenolble sources of 
valuable data and yet minimally disruptive. 

Since there Is nothing much more Important for the development 
of a program than being sure of what has been learned so far, It seems 
worth the risk to use trained observers and Interviewers In the field 
wherever a sound research design dictates. 

Programmatic Judgments and 
Technical Judgmen ts 

As Indicated In reference to the concept of evaluation Itself, 
judgment is a basic part of the process. Describing Is not evaluation, 
measuring Is not evaluation; comparing begins to be evaluation, 
because It Implies setting one thing against another In order to make 
a Judgment. 

In so many cases, especially those In which the evaluation 
plan has not been carefully designed In advar" . the descrtpttve- 
level data-gathering must Involve Judgment. i,iu-dd. If the data- 
gathering procedure uses questions that demand Judgments on the part 
of the respondent or the observer- Interviewer, or asks for descriptions 
of past Judgments, It Is dealing with Judgment. But these are 
technical Judgments not programmatic Judgments. 
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The judgment stage In programmatic evaluation Is a process 
of comparing Information gathered from the field against a standard 
that Is based on a value position about the program . Thus we draw a 

contrast between technical Judgments (decisions and judgments that 

reflect the beliefs and values of the technician) and programmatic 
judgments (decisions and judgments that are made about the 
descriptions or measurements on the basis of comparison with 
standards or value-based criteria about the program), The former 
are Important data or sources of data for the description and 
measurement stages, but "-.hese technical judgments alone do not con- 
stitute evaluation— at least certainly not programmatic evaluation. 



Reducing Rival Hypotheses 

Many evaluation plans have weaknesses that arise from "rival 
hypotheses." A rival hypothesis Is some other reasonable way to 
explain the data (an observation or measurement). Some of the more 
common rival hypotheses and the "rule-out" procedure for each are 
Indicated In the I ist fol lowing. Attention to these weaknesses will 
Improve the Integrity of the evaluative research!; 

Sample Rival Hypotheses Rule-out Procedures 

I. Learners already had the Pre-post testing (testing 



learnings said to have 
resulted from the 
Instruction. 



before and after the 
Instruct Ion) . 



2. 



The learners who volunteered 
for the testing or Inter- 
views are In some way 
different from those who 
didn't. 



Test everyone or a 
random sample (not 
volunteers! ) 



3. 



You see what you want to 
see. 



Test-«don*t rely on 
Judgments and opinions. 



People tell you what they 
think you want to hear. 



Don't bother to ask 
direct opinion questions- 
use unobtrusive measures 
Instead. 
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The Problem of General Izabi 1 tty 

Technically, external validity Is the degree to which the 
findings can be generalized to other situations. At the very least, 
general Izabl l lty demands-that the study be based on -a valid random 
sample. 



A VALID 




RANDOM 




Can surely be expected 
to be a picture of what 
It Is said to represent 



Each part has exactly 
equal chance to be 
Included 



SAMPLE 




Part, not al 1 , but 
representative of 
the whole 



If a sample Is called a "random sample," and It Is only a 
convenience sample. It has been misrepresented. If a generalization 
has been made to a whole from some part not validly representative. It 
is wrong. 

When a non-general Izable finding Is reported, the evaluator 
Is free to suggest (hypothesize) the possibility of generalization If 
he feels that there are similarities between the sample and the whole 
on all crucial matters that pertain to the findings. Always write these 
sorts of "soft" findings as suggestions or hypotheses, not, as a 
conclusion. 

The Problem of Verbal Data 

Analyzing verbal data demands skills and patience. One 
reason that multiple-choice or short-answer Items are preferred 
for most purposes Is that they are much easier to quantify} they 
can be readily converted Into numbers. For example. If we want to 
know the ac|e, sex, and quantity of the participants in a certain 
program we could use one of these two approaches in writing the 
questionnaire: 
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APPROACH I: 

Please describe the participants In the programs 



APPROACH II: 

How many participants are In the program? 

How many are male?^__^ f ema I e? 

What Is the total for each age? under 15 male: ^female: ^ 

15-20 male:_ f ema 1 e : 

21-30 male: ^female: 

over 30 male: ^female: 

The advantage of Approach I Is that you might learn much more 
about the participants; but since It was already decided that the 
needed Information Is age, sex, It Is unlikely that Approach I will 
provide this Information. If we really don't know what we want to 
know, Approach I Is satisfactory. But when we know what It Is that 
we need to find out Approach II not only assures that the response 
will be concerned with the matters of greatest Interest, but It will 
bring responses that are easy to categorize and easy to quantify. By 
pre-determlning the categories of analysis—for example, the age 
categorles--we make It easier for the respondent and we also make the 
analysis more manageable. Consider the confusion that would occur 
If we asked Instead, "How old are the participants?" Response would 
say, "Most are young but several are much older," or, "Almost 
all are In their twenties." How can we Interpret such responses? 

Researchers sometimes talk about "fishing expeditions," 
meaning to draw up In a "net" many kinds of Information so that they 
can be sorted out--hoplng to find one or two Important factors from 
among many. Fishing, as an evaluative research procedure Is very 
expensive, especially In the more complex sorts of non-formal 
education. 
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Some Basic Terminology 

Many people find that the literature on evaluation is 
technical, complicated and confusing. One of the problems Is that 
even In the professional literature the vocabulary of evaluation is 
not standardized. As might be e;(pected in any rapidly e;(panding 
technical or scientific field the consequences of reconceptual Izatlon 
find even the "experts" with somewhat varied viewpoints and even 
more varied ways of saying things. 

We hope not to add to the variety of language used to discuss 
evaluation. Rather, we would like to simplify and suggest certain 
standardization of the language, at least as needed for planning 
evaluations of learning effectiveness in non-formal education. 

The book most highly recommended for further study In educa- 
tional evaluation is Worthen and Sanders, Educational Evaluation: 
Theory and Practice, 1973. Although the book apparently gives 
attention only to the problems of evaluation In formal education, 
two factors commend It to our attention: (I) Its theoretical basis 
Is more comprehensive and thorough than previously available In one 
volume; (2) Its structure Is eclectic and yet discriminating, pro- 
viding In one compilation a whole collection of excellent contemporary 
papers on evaluation. A similar and even newer book of similar 
characteristics and worth is Payne, Curriculum Evaluation, ]$7k, 

A S . fiigested Comprehensive Approach 
Organizations and programs using new delivery systems have 
notably increased their concern for evaluation. Beyond this, even 
those organizations and programs that utilize long-standing and 
classical modes of educational delivery have shown a remarkable 
Increase in evaluative activity within recent years. One reason, of 
course. Is the Increased emphasis on non-formal education} It has 
produced a series of questions, most especially questions about the 
effectiveness of the educational activities, and such questions tend 
to increase the organization's awareness of the need to know. 
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BASIC VOCABULARY OF THE EVALUATION OF LEARNING 

Experience *. The process of relating to, being affected by, and 
affecting one's surroundings. 

Behavior ! The observable actions, verbal responses, and demonstrated 
feelings of a person. 

Learning ; Changes In behavior resulting from experience, 

Persistent Learning *. Change In behavior (learning) that are long- 
term, In the sense that they are not soon "forgotten." 

Cognition, Cognitive *. Having to do with the processes of mind called 
"knowing," "understanding," "perceiving." 

Psycho-motor *. Having to do with the processes of learning In which 
mind and neural functions Interact to produce "physical 
skills." 

Affect. Affective *. Having to do with the processes of mind called 
"reeling," "attitude," "appreciating," "valuing." 

Pre-test : A nieasurement made before an educational experience. 

Post-test : A measurement made after an educational experience. 

Observation *. Looking for evidence of a particular behavior or set of 
behaviors. 

Measurement *. Making observations In a systematic way so that evidences 
of behavior are counted. 

Assessment *. Examining records of observations or measurement In light 
of some criterlum or prediction. 

Evaluation *. Weighing the outcomes from an assessment procedure against 
a value statement or system of values. 

instrument s Any prepared device, material or test used to standardize 
(make more similar) the observation or measurement of two 
or more subjects (learners). 

Protocol *. A schedule of questions used to standardize an interview 
' procedure (hence, one example of an Instrument). 

Unobtrusive Observation or Measurement *. A procedure designed to get 

' evi'dehce without the i earner being aware--thus Intended 

td' Increase validity of the observation. 
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Outcomes that were formerly hoped and assumed now must gain 
respectability through proof of an empirical sort. Another reason 
may very well be the natural consequence of Instructional technology's 
emphasis on statement of object Ives— evaluable objectives. One of the 
most predictable preoccupations of a consultant in design and program 
development is the matter of objectives that can be evaluated. In 
fact, the spelling out of objectives and the development of evaluation 
plans seem often more emphasized than the development of an effective 
del ivery system! 

Recent evaluative experiences In five nations (added to 
similar reports from other nations) have impressed us that hardly 
anyone in non-formal education needs to be persuaded of the Importance 
of evaluation. At the same time, two serious problems have emerged 
that lie behind the relatively Insignificant consequences of .-^valuation 
as presently practiced. First, the concept of evaluation heid in many 
programs of non-formal education is both primitive and unpromising. 
Second, and closely related, the levels of skills and technical pro- 
ficiency of evaluation within non-formal education tends to be limited. 

The concept of evaluation as a set of summative and descriptive 
processes through which ultimate judgments and propagandistic state- 
ments can be rendered Is common. A research-to-prove frame of mind 
seems to be foremost in the mandates of many evaluation teams. The 
evaluators themselves have usually been trained in a sociologlcal- 
demographical approach to description; thus the evaluator's sophistica- 
tion Is adequate to cause him to' reject the research-to-prove outlook 
but not adequate to give a meaningful or worthy alternative. During 
observations and conferences we found many cases of evaluation teams 
and project administrators being on if recoi.-.i lable wave-lengths. 
Until the concept of evaluation is enlarged and the training of 
evaluators is increased to match, evaluation will contribute 
relatively little to increased learning effectiveness In non-formal 
education. 

A typical but larger-than-usual case Illustrating this 
problem was found in an impoverished section of a large nation where 
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a statewide program of school extension through television was being 
"evaluated" by a regularly employed evaluation staff of ten people. 
The program administrators were being provided an almost over- 
whelming array of demographic data--who Is In the program, where they 
live, their socio-economic position, level of prior formal education, 
age, civil status, and so forth. There was nothing against which to 
assess the data and virtually no way to use the data. No expectation 
models have been built to Identify the relevant characteristics and 
Intended changes In the audience for which the Instructional experiences 
had been built, and no way to tell if the audience was similar to or 
In what ways dl'^^'rent from the original expectations. To the credit 
of this evaluatk team, they were carrying out a testing program to 
determine the rate of "passing" students and the distribution of scores 
of the periodic and final tests. But no one used the test data except 
to make claims and propaganda about the rates of accomplishment. 
(True to a classical European value from formal education, the "hard- 
ness" of the prog.iin was accepted as a proof of its quality— and 
"hardness" was evidenced by high rates of failure.) No pre-testlng 
had been conducted, so there was no way to establish that the program 
was accomplishing anything at all. 

The Ironic and yet probably encouraging reality is that 
evaluation Is recognized as a promising and desirable component of 
educational program development. At the same time, however, one must 
fear that too much advocacy of this sort of almost useless evaluation 
may result In such unproductive and frustrating experiences that program 
administrators may decide that they havl^ been victimized by one of 
technology bad jokes. 

Three Stages of an Organization's. 
Use of Evaluation 

On the basis of what we have observed In non-formal education 
tt would seem that there may be a set of developmental stages through 
which an organization proceeds. The stages and some of the main 
characteristics of each are Indicated following*. 
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Stage I. Informal Evaluation . 

a. Emphasis on persona) communication 

b. Data gathering of miscellaneous sorts 
Ci Lacl< of documental experience 

d. Criteria of effectiveness: (1) general ideologies} 
(2) various experiences 

Stage 1 1 . Structural Description Assessment 

a. Emphasis on riescriptive data 

b. Organized data gathering 

c. Focus on problems and concept of improvement 

d. Increased availability of documentation 

e. Clarified criteria of effectiveness 



Stage III. Quantified Assessment 

a. Emphasis on quantitative data 

b. Assessment focused on achievement of objectives 
''fc. Quantified emphasis for the entity 

'<d. Formalization of the criteria of effectiveness. 



Criteria and Key Questions 

An effective system of evaluation for a program of non-formal 
education will have the following characteristics: 

1. The major purpose is to enlighten decision-making at 
management and operational levels. 

2. The focus (emphasis) is on specific questions that are 
important to the organization; these are questions or 
issues relating to more effectively performing the 
service. 

3. Data-gathering is related to (and limited to) the questions 
under study or examination. The instruments (questionnaires, 
forms, interviews, etc.), are built to get information 

that will be used in answering the question. 

Questions for evaluation are related to the theoretical , 
and procedural basis of the organization's work. The 
theory as well as the practical matters of operation are 
always subject to change, on the basis of the evaluations. 

5. Descriptions, measurements, and assessments are carefully 
made by objective procedures . Guesses (when their use is 
absolutely necessary;, are labelled as guesses . Opinions 
are labelled as opinions . Actual measurements are 
quantified when possible. 



While inherent In "efficiency," there is an inherent danger 
in these leading to rigidity. 
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BEST copy mmii 



EXPANSION OF CONSEQUENCES (OUTCOMES) 
IN ROBERT STAKE'S MODEL 
OF DISCREPANCY ASSESSMENT 



INTENTIONS 



I 



ACTUALITIES 



PRECEDENTS 



OPERATIONS 



ACHIEVED OBJECTIVES 






ACHIEVED ENABLING 
OBJECTIVES 



1. Is each objective logically representative of the purposes? 

2. Does each enabling objective have d logical (theoretical) 
probability of leading to the objectives? "'^^^'^ai; 

3. Does the achieved enabling objective lead to achievement of an 
Object I ve? 
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PURPOSES: 



GOALS: 



OBJECTIVES: 



INTENTIONS 



What Is the effect we 
want to have? (Why 
are we doing this?) 



What do we want to 
happen as a result 
of what we will do? 
(Changes or states 
that we would 1 Ike 
to bring about?) 



How win we know our 
goals are being 
reached? 

- under what cl rcum- 

stances? 
-will what behavior 
(acts or expres- 
sions)? 

- be expected, with 

what degree of 
accuracy or 
frequency? 



BEST COPY AVAILABLE 

ACTUALITY 



What do our learners 
accept as the purpose 
of the experience? 



What do the learners 
want to happen? 



What are the learners 
looking for as evidence 
that their goals are 
being reached? 



PRE- 
CONDITIONS 
IN 

LEARNERS: 



What sort of persons 
do we expect to do 
this for? 



What sort of persons 
do we actual ly work 
with? 



INSTRUC- 
TIONAL 
OPERATIONS: 



What do we Intend to 
do In order to 
achieve the goals and 
object Ives? 



What we actual ly do 
toward achieving the 
results. 



CONSE- 
QUENCES IN 
LEARNERS: 



What do we want as 
results of our effo 



I O 4J| 

rts?i'ij §i 

(Thts'wiil be the 4^ S g}-^ have done. 
Dbject Ives-above-ln st 



What we actual ly see 
as results of what we 



obj 

evaluable terms) 



Figure 8. --Questions for a Discrepancy Assessment. 
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CONSEQUENCES 
IN 

LEARNERC 



WHAT DO \/E WANT 



AS RESUL 



S OF 



OUR EFFORTS? 



EVALUATION 
COMPONENT 



WHAT DO WE ACTUALLYI 
SEE AS RESULTS OF 
WHAT WE DO? 



EVALUATION COMPONENT 



What are the 
available 
sources of 
Information? 



How will we 
get the 
Information? 



What Is our 

assessment 

standard? 



What will we 
look for 
that we want 
to find? 



I. 

2. ' 

3. ; 

5.' 



etc. 



etc. 



etc. 



etc. 



What win 
we look for 
that we 
don't want 
to find? 



11. 

12. " 

13. ' 
14. 



etc. 



etc. 



etc. 



etc. 



What changes would be made If the assessment standard were 
not met? (For each "look for" Item.) 

1. 

2. 

3. 



5. 

6. 

7. : 

8. 

9. 

10. ' 

11. 

12. ■ 

Figure 9.<*-Bui Iding an Evaluation Component. 
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6. Judgment is an essential part of the prodess, bringing 
together the clearest of value-statements and the most 
specific, valid and reliable data. 

From all of these suggestions about l<lnds of useful data, It 
is easy to see how complex and sprawled a thorough evaluation might 
become. It Is necessary to mai<e some choice; one cannot Include 
everything within an evaluation, no matter how nice that might be. 

Deciding what Is and what isn't worth the time and expense of 
Including In an evaluative study Isn't easy. One useful rule-of- 
thumb Is to ask "What difference would It make?" If It appears that 
no matter what evaluative study might i'eveal on a certain matter 
nothing could or would be done about It, then the factor might well 
be left out of the evaluation. 

Even more helpful In making these decisions about what is and 
isn't important in a given evaluation In the model provided by Robert 
Stake (1967), adapted for Figures 7 and 8 given earlier In this 
section. 

A nxieties of the "New Pioneers" 
Within many of the "new pioneers" who are at the helm In non- 
formal education there Is a deep commitment to flexibility and non- 
Institutional Ism. Especially among those carrying on the various 
kinds of educational efforts toward community development, and even 
among those engaged In the newer concepts of literacy education, 
rigidity and formalism Is feared. Some of these people seem to have 
an historical and sociological awareness of the probability of 
rigidity following close upon standardization and regulation. Others 
seem less aware of historical precedents but nonetheless they sense 
the difficulty and are concerned with Its harmful consequences In 
terms of reduced teaming effectiveness. In general, the outstanding 
and aggressive leaders In community development treat flexibility and 
situation-specific responses to social needs within given social con- 
texts as if these were the new absotutesi (One is amazed at the 
absoluteness of relativity!) 
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In the face of this high valuing of flexibility and Its 
abhorence of "prescriptions" and "recipes," theorybul Iding Is an 
uphill battle. The "new pioneers" are disinclined to describe how 
they achieve their successes lest some "old-model" educators come 
along to copy and, It Is assumed, to. misapply the procedures. 

The Inventiveness and creativity that underlies the work of 
the "new pioneers" Is a powerful and refreshing force In education. 
One may even hope that this spirit and tone will somehow stimulate 
formal education. But there Is an Irony In the situation} the uses 
of new technologies of communication and newer concepts of society 
and human development Identifies the "new pioneers" with science, 
objectivity, experimental Ism, and basic to It all, empiricism. Yet 
the essence of science and scientific method Is having a difficult 
time of It within much of non-formal education! 

Taking Brazil as a case, one finds a dazzling array and variety 
of creative, clever. Innovative and apparently promising modes and 
forms of non-formal education. These range from simple extension of 
the schooling enterprise (for example. In Maranhao where children are 
gathered Into teacher-less classrooms to watch their schooling on 
state-wide broadcast television) to programs that bear no resemblance 
to formal education (for example, a program of literacy that Is based 
on a one-tcach-one per disclpleship model). In fact, the variety and 
proliferation has raised eyebrows In the national capltol where 
responstbtl tty for protection and effective distribution of national 
resources gives rise to a counter-value: selection and efficient 
standardization on proven models, accompanied by limited and care- 
fully monitored experimentation. Certainly the rich variety of 
Inventive forms of educational delivery would be a credit to a 
wealthy nation, but even if scarce resources were not at issue, the 
state of human knowledge--sclence--ts being advanced very little by 
these many "promising" programs of non-formal education. In the 
?nterest of scientific knowledge and the worldwide advancement of the 
human conditiot>» more precise description and responsible evaluation 
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are needed. Theory— educational , soclolocitcal , and social- 
psycho log lea) --could be advanced substantially if even half of the 
various non-formal education activities in the world today were sub-, 
mitted to scientific observation, description and evaluation. Further, 
one suspects that the ultimate result of such a variety of programs 
win be the survival of those that are able to make the most con- 
vincing political noises--those that are not necessarily the most 
effective in terms of learning , but in terms of political propaganda 
and "Influence." 

Thus the "new pioneers" in education do themselves a disservice 
by resisting involvement with scientific processes of description and 
evaluation. There perhaps are four kinds of people or four kinds of 
stances that explain the resistance of those who owe so much to 
science and technology yet resist making their contribution to 
broadly defined human knowledge: 

1. Those who fear the exposure that evaluation would 
bring: the FEARFUL; 

2. Thosp 'ho are so completely convinced of the worth, 
significance, and superiority of their own approaches 
that they see no need to raise questions: the 
BELIEVERS; 

3. Those who are willing but technically unable to 
engage In scientific procedures, because of 
physical and staff limitations or lack of know- 
how: the NEEDY; 

k. Those who are resistant to scientific description and 
evaluation, believing that through scientific 
participation their approaches would become less 
flexible, less open, less situation-specific the 
RESISTERS. 

For the FEARFUL we have little to offer. 

For the BELIEVERS we have a challenge: open yourselves and 
your programs to dialogue about scientific propositi ons • E i ther you 
will learn something or you will make important contributions to 
human understand ing» or both I 
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For the NEEDY we offer in this chapter a basis— though only 
ru(limentary"-for the concepts and procedures of scientific inquiry* 
description, and evaluation through which-- if the resources can be 
found— they might make practical and profitable investments in clari- 
fying ind probably improving learning effectiveness in a given program 
of non-formal education. 

For the RESISTERS, this chapter is particularly intended to 
reduce the anxiety about loss of flexibility. For these people we 
have great respect because, of all the "new pioneers," these people 
seem to be the most dedicated to two values that we accept as central 
to our concept of learning effectiveness: 

1. The importance of educational programs being 
des.gned on the basis of a comprehensive view of 
the global social reality within which learners 
live and gain their rewards. 

2. The importance of effective interpersonal relation- 
ships in the acquisition and prompt use of new 
knowledge. 

We have engaged in several countries, with "resisters" in 
respectful dialogue about the importance of clarifying, describing 
and sharing what they are learning about human learning in these new 
configurations. And we have drawn from precedents in science and in 
the sociology of organizations and institutions to demonstrate how 
scientific description, theory building and dialogue can be used to 
assure long-term flexibility and a higher degree of resistance to 
institutional ossification. 

The Nature and Role of Theory 
The argument is based on the nature of theory. Theory, in 
science, is a concept or system of concepts that binds together the 
best of what is already known about the observable realities. Theory, 
in reference to a given educational problem. Instructional task, or 
learning situation is that body of knowledge that provides the basis 
for new hypotheses. Hypotheses, tested in observable situations. 
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provides more of the substance of theory --whet her In terms of extended 
support for the extant theory, augmentation of that body of theory or 
refutation of parts of It. 

It follows, therefore, that theory always exists In any educa- 
tional operatlon--whether good theory or poor depends on the rigor of 
statements of what is happening and what has gone on before. In an 
operation where the basis for planning and operation Is "hunch" or 
unsupportable opinion, theory is weal< and the probability of adding to 
the understanding of human learning is relatively low, Where an 
operation Is based on carefully defined understanding of the human 
varlables--especially If an appropriate body of social science theory 
exists in reference to the particular case, then the probability of 
adding to {knowledge of the processes and function of teaching and 
learning is considerably higher. 

But there is another factor: any educational operation which 
is seeking new solutions or pursuing goals not well understood In 
previous experiences is particularly subject to premature conclusions 
based more on spontaneous coincidences than on scientific evidence. 
We have observed in non-formal education, especially within content 
areas in which formal education has been relatively unsuccessful, a 
tendency to "invent truth." It is Important to remember that most of 
the jpadequacy of formal education Is attributable to Its non-scientific 
characteristics rather than to any misdirection through science. If 
any social enterprise lacks a basts In scientific theory. It Is 
particularly vulnerabh^ to being locked into a doctrinaire or 
ideological embrace; the supporters of a particular viewpoint or a 
particular contention about how the Job Is to be done can dominate 
relatively easily. Earlier we described these sorts of people as 
"BELIEVERS." They are not much concerned about evidence, they are 
even less concerned about Inquiry; their position is based on what 
they want to believe. As we view the maze and variety of forms and 
programs of non-formal education, the probability that all 
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approaches to a given target problem could be equally valid seems 
low. Surely, some means of determining which approaches are more 
ef fective«-better yet, more cost-effective— must be enlisted unless 
the whole field of non-formal education is to waste itself away 
through bad investments. There are three roads to choose among: 

(1) support for any and every clever idea about how to conduct non- 
formal education for given purposes-- this is the expensive road; 

(2) competition among various programs on the basis of noise-matcing 
and political fanaticism--thi8 is the wasteful road; or (3) con- 
ducting or orderly data-gathering to determine the effective and 
ineffective aspects of each program, mal<ing decisions about continua- 
tion and alternation on the basis of cost-effectiveness--this is the 
scientific road. 

Documentation and Analysis; A 
Vaccination Against Rigidity 

Those who contend that flexibility and creative response are 
vital in effective non-formal education are apt to b«. disturbed by 
the insistence here upon descriptive and evaluative research. We 
have even encountered those who argue that descriptive documentation 
of the way a given operation is conducted will, in itself, bring on 
the "disease" of rigidity. They argue that writing tends to freeze 
ideas into permanency and that bureaucrats who get their hands on 
documents about "the way we do things" are apt to use the documents 
for many years as the basis of Judgient about the way we ought to do 
things. Although there is, unfortunately, some experience to back up 
their contention, we persist in the argument that an undescribed, 
undocumented operation is more vulnerable to fall under the dictation 
of the BELIEVER and thus is apt to become rigid for his reasons. On 
the other hand, if one I'eally values creativity and sees that con- 
tinuing to learn from experience is basic to steady human progress, an 
open system--subject to orderly change-;;sshould be preferred. That is 
exactly what we are tall<ing about here; descriptive ard evaluation 

if 

research is basic to an open systeVn wherein orderly rhange can occur. 
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To use an analogy, if rigidity in an instructional delivery 
process Is the I'disease," then documentation of the practices of the 
process Is the vaccination. The analogy suggests that the mild and 
controlled exposure to the infectious substance induces antibodies 
that prevent subsequent calamity. Thus we grant that documenting a 
system suggests exposure to a mild form of rigidity, but the long- 
term effects make it quite a wise risk. 

Evaluation or Experimentation? 

The logic of the paragraphs above, if extended In full, 
would argue for experimental research as a key element in the develop- 
ment of non-formal education. We are not prepared to go that far. 

Perhaps because we have seen so little substantial improvement 
In formal education come about through experimentation, or because of 
our difficult experiences in conducting experiments in vivo within ' 
complex social settings, we place no great hope in experimental 
studies conducted on a large scale. As we demonstrate in another 
chapter, experimentation on key issues can be important, but unless 
the experiential variables are extremely small and the experiential 
situation rigorously controlled, contamination of real studies is 
almost Inevitable. Further, after the variables are reduced and the 
situation controlled, what is left quite often bears little or no 
relationship to the "life situations" to which the findings are to be 
generalized. 

Descriptive and evaluative studies are all that we can urge in 
good faith. Indeed, they may be all that Is really needed, given the 
multifarious and ad hoc nature of most non-formal education. What Is 
needed most just now Is reliable information about how given programs 
carry out their work and what effects they are producing. To an 
experimentalist this may demand cause-and-ef feet proofs, but to the 
pragmatic maker of decisions in non-formal education It/ Is more a 
question of "exactly what are they doing, what evidence suggests that 
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they are getting the Job done, and what are they learning about how 
to do It better?" This frame of mind obviously Is vulnerable to all 
sorts of unsupportable assertions, but It Is the predominant construe 
tlve posture we find In non-formal education. The best thing that we 
can do, then. Is to help people do competent descriptive studies and 
responsible evaluative research. There Is wide-spread Interest In the 
findings of such studies, and the Implications will be used; we cannot 
say as much for experimental studies. 

The Ultimate Problem ; 
Learning Effectiveness 

Learnln>j effectiveness Is an elusive goal. Within the aspira- 
tions of any dedicated teacher, the intention to enable learners to 
learn effectively Is a persistent goal. This aspiration is fulfilled 
through a series of approximations. Always the goal is just beyond 
the accomplishment. Learning effectiveness is rarely. If ever, 
achieved In the absolute or ultimate degree. It Is a sort of vision-- 
an Ideal to be diligently sought after. "Learning effectiveness" or 
"effective learning" suggests both an achleveable goal and a con- 
tinuously projected Ideal. A given learning experience can be seen 
as "effective" for a learner, and at the same time, the teacher's 
ideal Is being extended toward an even more effective, more conse- 
quential, more potent learning for the next learner or for the next 
experience. The search for more effectiveness in the learning 
process should never cease. 

Critics of formal education suggest that many or most schools 
have lost their concern for learning effectiveness. In the institu- 
tional sense of having tended to "freeze" Into ritual and unchallenged 
habit a set of goals and procedures, the accusation seems reasonable; 
but to suggest, categorically, that all teachers and all Institutions 
of formal education have abandoned their concern for learning effec- 
tiveness seems unnecessary and unfair. The search for more effective 
learning is not unique to non-foimal education. 
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Non-formal education is particularly concerned with the 
problem of learning effectiveness because non-formal education has no 
other justification. Except for those sorts of non-formal education 
that are, in fact, disguised alternative forms of formal editcation» 
non-formal education has no system of artificial rewards, self- 
justifying certificates, or self-denied levels of accomplishment. 
Within the mainstream of non-formal education the reality of its 
effectiveness is in application and use of learnings. For example, 
formal education typically accepts performance on a test or "covering" 
a certain body of learning exercises as signifying accomplishment; 
thus effectiveness is measured in reference to abstract and remote 
criteria. Within non-formal education, the intention is to mal<e 
life-changing educational inputs to the learner, and then the frame of 
reference is application and life-style realities. Evaluation of 
effectiveness is based on a value system of up-graded human and 
social conditions. Thus within non-formal education learning (effec- 
tiveness is a matter of particular urgency and functionality. For 
non-formal education learning effectiveness is not an option, it is a 
mandate. 

The quest for more effective learning demands a capability of 
learning from experience. If there is no way to improve on past 
practices there is low probabi I ity of increasing learning effective- 
ness. For many, especially the newcomers to educational design and 
planning, there is a sort of "beginner's dream" of some great leap 
forward into a new era wherein learning will be more effective and 
less costly. Older heads are more inclined to expect the gains in 
smaller steps. Among educators there is an old adage that whereas 
one teacher has had twelve years of experience another had had one 
year of experience twelve times! The reference here is to the 
difference between gaining skills and understanding through experience, 
versus merely repeating the pattern of activities of the past. Within 
non-formal education even If one assumes potentially large leaps 
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ahead through new delivery systems, the educators (planners, designers, 
and teachers) who l<now how to learn from experience will be engaged in 
the continuing search for closer approximat ions* of learning effective- 
ness* 

Technologists of education have contributed new instructional 
hardware and gadgets; and to some extent these are valuable, 
especially since they open up new forms of educational delivery. But 
the technologists have contributed something more important? the 
concepts and procedures of formative evaluation. For those who are 
new to the term "formative," a word of encouragement is offered} 
formative evaluation is simply an extension of the venerable proposi- 
tion that one can learn from experience. Formative evaluation is a 
term that indicates the use of evaluative procedures as a set of tools 
to stimulate and direct change. For those who see educational delivery 
in terms of "systems," the idea of formative evaluation is seen as a 
focus on the cybernetics of that system--the mechanisms of autonomous 
and intra-system regulation that increase its probability of goal 
achievement. So much for the big words. 

In the past, most educational evaluation was focused on the 
learner, as if knowing his extent of accomplishment were the most 
important piece of Information needed by the educator. There followed 
historically, a period when evaluation--especial ly testing (descriptive 
measurement) --was focused on "diagnostic" or pre-learning conditions 
and characteristics in the learner. During this period education 
became more aware of "individual differences" that every learner arrives 
at the learning experience with his own previous learnings,, his own 
aptitudes, his own motivation and his own "readiness." Tht^s began that 
emphasis on accommodating individual differences that has led--tn overly 
rich western-style education— to the idealization of "individualized 
learning."" 
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The third and most recent stage in the evolution of educa- 
tional evaluation is represented by the distinction being made between 
formative and summative evaluation. The significance of this dis- 
tinction and the importance of the resulting new viewpoint lie in the 
proposition that evaluation can be a tool for the improvement of the 
Instructional system or learning system itself. In contrast with 
earlier concepts of evaluation in which the success or failure of the 
learner was the focus of evaluation, the new concept of evaluation 
focuses on the learning system and its successes and failures. Over- 
simplified, the earlier views of evaluation indicated which learners 
had to w( i k harder; which ones were "mal<ing the grade" and which were 
"unsatib actory." The new view asks about the learning system in 
terms of how it is satisfactory or unsatisfactory and what needs to be 
done to change it. For those who believe it is more humane to remodel 
systems to better fit the needs of people rather than to squeeze 
people into the molds of systems, this new emphasis within evaluation 
concepts and procedures has a strong appeal. 

And, of great importance to non-formal education, the new 
emphasis within evaluation offers ways and means to preserve flexi- 
bility and responsive capability within educational systems. Thus we 
see evaluation, especially formative evaluation, as having an important 
role in the continuing striving for learning ef fectivensss and in the 
Important matter of defending non-formal education against the natural 
tendencies toward standardization, tradition, institutionalization and 
the natural end of these tendencies: ossification. 



"The assumption that optimal learning effectiveness Is dependent 
on "learning at one's own rate," "learning on one's own," "learning on 
the basis of one's own previous learnings" is widely accepted within 
formal education. This view, largely unchallenged, has given impetus 
to instructional procedures that isolate learners from one another and 
emphasize out-of-context cognitive learnings at the expense of stunted 
affective development and similar non-social excesses. 
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Postscript; The Moral Dilemma 
of the Evaluator 

Technologists of Instructional systems tend to see themselves 
as specialists. For example, the Instructional design specialist tends 
to avoid the Issues of curriculum planning. His approach Is apt to be 
of this sort: "You tell me what you want the students to learn and 
tell me a little about what they are like and I'll work out some 
materials and plan some experiences that will assure that they will 
learn what you want them to." Some specialists in evaluation try to 
exempt themselves from anything but the ways and means of collecting 
and analy2lng data; they show strong aversion to taking on any 
responsibilities until someone else has spelled out the learning 
objectives In great detail. Their only role up to that point seems 
to be "needling" the operato*"-, of the program until some statements of 
objectives are written. 

U Is this "needling" or pushing, that can warp or prevent 
certain sensitive aspects of non-formal educational programs. The 
common mystique among the absolute empiricists In education argues 
that something Isn't real If It can't be measured. As an abstract 
argument this holds up rather well: anything that Is actually 
happening is descr ibable; anything that can be described can be 
quantified in some way. The poet might cringe at the thought of 
quantifying the characteristics of a rainbow, but It can be done. 
But are the quantifiable aspects of a rainbow the same thing as the 
rainbow? This Is the dilemma! When operators of an educational 
program--especlal ly a pioneering venture or a fragile new solution to 
a persistent problem (as non-formal education usually tends to be) — 
are pushed too hard and forced to specify their purposes in quanti- 
fiable terms, the essence of the program may be left by the wayside 
In the scramble to find those aspects that can be quantified. 

Evaluations based on measurements are surely more apt to be 
objective than those basefd on verbal descriptions alone. But an 
evaluation that Is based on quantifications of the peripheral factors 
In a program may be worse than useless. 
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Thus evaluation specialists, If they are to be at all helpful 
In non-formal education must make three concessions! 

1. Evaluators must listen to program developers and operators 
In order to come to an understanding of the essence of the program. 
Putting It another way, evaluators should not put program people on the 
defensive about the specificity and quantif labi 1 Ity of objectives. 

2. Evaluators must accept the possibility that some worthy 
goals are not fully reducible to quantitative objectives at a given 
point In time. The creative educator should not be forced to conform 
to the limitations of science and technology. These, Instead, should 
be harnessed to serve the purposes of the educator. There Is, of 
course, a dilemmr. here! we general ly argue that non-formal education 
Is more able to spell out Its objectives than Is formal education, yet 
we argue for patience; this Is because we see certain programs of non- 
formal education (especially those that deal with consclent Izat Ion of 
peasants) coming to grips with some of the seriously neglected aspects 
of the western world's concepts of education and the needs of many. 

It Is especially for these programs that we plead for restraint in the 
application of forceful technology. 

3. Evaluators must be content with the evaluation of Interim 
objectives as representative of Interim goals In reference to programs 
that are only partially developed or partially Implemented. The 
reference here, of course. Is to the many cases where a piece of a 
complex program of non-formal education must be put into action (and 
perhaps become self-sustaining) before other facets of the program are 
made operational. In such a case evidences of accomplishment of the 
ultimate behavioral objectives may be Impossible until some later 
date. A helpful evaluator will not prematurely force the Issue about 
evaluating the ultimate goals and objectives of the program. 
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The road to wlsdom?-- 
Wel) it's plain and simple to express: 

Err 

and err 
and err again 
but less 
and less 
and less. 

(Piet Hein; Grool<s, I966) 
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CHAPTER V 



EVALUATING, CHANGING AND INCREASING 
LEARNING EFFECTIVENESS 



Wl 1 1 lam A. Herzog, Jr. 
and 

Raul Gamio Santoyo 

The worker In non-formal education frequently faces the 
question: "How am I doing?" This breaks down Into a series of 
issues that go to the heart of his program objectives: How effective 
is the program? How good are the materials? What learning is taking 
place as a consequence of participation in the program? In what ways 
do people do things differently as a result of having "gone through" 
the program? 

The purpose of this chapter is to show that evaluative research 
can be utilized as a tool for providing systematic improvement in 
learning effectiveness. Specifically, we will briefly mention some of 
the issues related to evaluative research, describe a rural non-formal 
education program which contained an evaluative research component 
in its organizational structure, and discuss some of the implications 
of that experience. 

Evaluative Research 
Evaluative research presents some distinct differences from 
theoretical research. It is oriented toward problem identification 
and problem-solving. It operates within administrative and operational 
constraints imposed by the nature of the program of which it is a part. 
And it must collect and analyze data and then report back findings 
with relative speed if its results are to have value for the program. 
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This Is not to say that theoretical research and evaluation research 
are Incompatible; Indeed, as we point out later, they are sometimes 
complementary. Theoretical questions have been examined within the 
conduct of evaluation research, but examples of the harmonious marriage 
of the two are not easy to find. 

Evaluative research can be most effective when It Is used to 
measure clearly stated program objectives. Ideally, such objectives 
will be framed In behavioral terms. When the researcher Is asked to 
evaluate the effectiveness of a given program his response must be: 
"Tell me the specific behavioral changes your program Is aimed at 
producing and I can go measure and see If you are achieving those 
objectives." Broadly defined global program goals will produce 
ambiguous evaluation research results. 

Two roles for evaluative research have been Identlfled-- 
formatlve and summatlve.' Formative evaluation deals with materials 
and programs at the developmental stage. It provides feedback for 
modification and Improvement before materials or programs are considered 
In final form. Summatlve evaluation measures the final, finished 
produce— materials or programs— and attempts to determine whether the 
produce has reached its objectives and whether its results merit 
repetition In another situation. It may not always be clear whether 
a particular evaluation is formative or summatlve, depending on the 
status of the activity in progress. But whether It be formative or 
summative, it Is obvious that one of the main functions of evaluative 
research Is to make 'foci s ion-making processes more effective. 
Evaluative research may lead to a decision to revise materials before 
a program gets underway, or It may help decide whether a given "pilot 
project" merits expansion to a larger regional or national effort. 

PCP Mexico— A Case Study in the Use of 
Evaluative Research 

The use of evaluative research as a feedback for program 

development will be Illustrated by a program of rural training In 

Mexico, known as Programa Campesino de Productlvidad (PCP), roughly 
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translated as Peasant Productivity Program. PCP came Into being In 
1969 as an outgrowth of a parent Institution, the National Center of 
Productivity. PCP was charged with the training of the rural Mexican 
man and woman through development of special programs, use of the 
mass media, and providing specialized methods for change agents worl<- 
Ing in the rural sector. Specifically, this was to be accomplished 
by: 

1. Increasing the efficiency of the agricultural 
production units by enlarging the organizational 

and administrative capacity of the farmer, principally 
those who have been beneficiaries of Agrarian Reform— 
the small landowner and "ej Idatar io."2 

2. Diffusion of information through more modern techniques 
to increase efficient use of production units. 

3. Establishing a service which would be capable of: 
(a) developing training programs for personnel, 
specialized in social communication and rural 
administration; and (b) producing and evaluating 
prototype materials for the peasant clientele. 

Organization and Activities of PCP 

PCP activities are carried out by three departments. The 
first of the departments Is training, with responsibility for the 
development of course materials and the conduct of training programs 
in the field; the second department is charged with the preparation 
of radio and TV programs, films, audiovisual aids, and the design and 
illustration of printed materials. The Research Department collects 
data on target audiences prior to the preparation of training 
materials and evaluation of effectiveness of materials, courses, and 
other PCP activities. 

The specific programs of each department include the following 
kinds of activities: 

1. Training Department . "-The activities of the Training Depart- 
ment come under thfee main headings: Rural Administration, Peasant 
Leadership, and Home Administration. 
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The Rural Administration program Is aimed at providing the 
peasant with sufficient technical knowledge and Information so as to 
allow him to make better decisions In the allocation of his own 
resources, with the aim of Increased productivity. Among the 
training programs which have been developed and administered are 
courses In Irrigation, fertilizers. Insecticides, agricultural 
credit, and other commercial aspects of the farm enterprise. 

The Peasant Leadership modules are aimed at preparing farm 
leaders to make more efficient application of community resources. 
PCP began by defining Its clientele as those leaders chosen by the 
community for some administrative task—municipal or ejidal. The 
courses for peasant leaders, to date, consist of five themes: 
principles of agrarian legislation, institutional services for 
agrarian activities, principles of social organization, administration 
of community resources, and civic activity. 

The Family Education program has as its purpose the "Increase 
of woman's capacity within the rural context so that she might have a 
more active and effective role In the affairs of administration, 
organization and economics of the family." In order to make the farm 
wife an effective agent for socio-economic change within the community, 
courses deal with home administration, family relations, and consumer 
education. 

Training Department personnel are responsible In each of the 
three major areas for the development of these training programs, 
conduct of pilot programs and subsequent revision, and training change 
agents from other Institutions In the use of PCP materials. The 
latter activity fulfills a major PCP goal of creating a multiplier 
effect by making Its materials available to other organizations. 

2. Production Department .—The Production Department Is 
responsible for the design and production of didactic materials for 
the activities of the Training Department. While these consist 
mainly of printed material and audio-visual aids, the department also 
makes short feature-length films on topics related to the cout'ses and 
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to rural problems. Radio and TV programs are also produced. The 
latter have been utilized In the TV forum format, where groups of 
farmers meet weekly to view the ha If -hour TV program and remain to 
discuss the applicability of concepts to their own particular situa- 
tion. The radio and TV programs provide reinforcement by presenting 
concepts which have been previously covered in training programs 
which many of the farmers would have attended. 

3. Research Department .— The Research Department was created 

to provide a data-based orientation to PCP activities and to evaluate 

the various activities and materials of the Training and Production 

departments. The department Is charged with: 

> performing descriptive studies In the geographic 
areas of PCP pilot programs which will provide an 
empirical description of the target audience. 

- evaluating the appi ication of the training programs: 
objectives, contents, methods and techniques, materials 
and the use of mass media. 

- assessing the amount of change occurring In the areas 
where PCP is worlting that might be legitimately 

\ attributed to effects of the training programs. 

PCP has carried out field programs in two project areas: one 
In the state of Mexico and the other In the state of Guanajato. 
These activities have been of a pilot nature and therefore geographi- 
cally I Imited in scope. 

In each area, the first research task was to produce descrip- 
tive studies of the areas and the specific communities in the project 
area. The preliminary research included Interviews of a sample of 
farmers to determine their perceptions of needs and interests and 
those of their families. 

A second step was to gain the cooperation of key agricultural 
Institutions In each area to collaborate with the project. In the 
state of Mexico, collaboration was secured with the National School of 
Agriculture; In Guanajato with the Secretary o^ Hydraulic Resources 
(Irrigation service) and the Central Agricultural Bank. 
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Following an identification of the needs of the farmers and 
the institutions that could be of service to them, training programs 
were designed. Particularly in the course concerned with rural 
administration an effort was made to make farmers aware of institu- 
tional services which were available to them. Necessary materials 
were prepared including teaching aids, slides, posters, and handouts 
for participants. 

The training sessions for the farmers were held in the com- 
munities themselves, usually in a rural school building. Groups of 
farmers, enrolled In the courses, typically ranged from 10 to 50 
participants in each community. 

I 

Utilization of Evaluative Research ! 

Several Idnds of evaluative research projects were carried 
out. Each resulted in particular deciston-mal<ing effects. 

1. Baseline Community Studies . --The philosophy of PCP program 
development assumes a data-based knowledge of the target audience (or 
client system) on which to prepare training programs and materials. 
This data is to be provided through descriptive studies carried out 
by the Research Department. 

The early exploratory studies, carried out in the states of 
Mexico and Guanajato, produced descriptive data on the use of Irriga- 

s 

tion systems, knowledge and utilisation of institutional services 
that operated in the area, availability of credit programs, com- 
mercialisation of farm products, and innovativeness iri adoption of 
agricultural techniques. In addition, data on the usual demographic 
and socio-economic characteristics were gathered. But because of the 
urgency of getting the training programs Into operation, most of the 
materials were prepared and put into use before tKe research results 
were available. In part, this occurred because the ambitious scope 
of the research produced more data than could be rapidly analyzed, 
but also because of the institution's tack of familiarity with the 
research process. 
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After the experimental program had been underway In La Begona 
(state of Guanajato) for two years, a data bank for each of the 13 
communities that constituted the main field worl< was created, pro- 
viding a socio-economic profile for e^?ch community. Thus the various 
kinds of courses, materials, and other communication could be better 
evaluated with reference to the target population. 

Another kind of assessment of the needs of the target audience 
is exemplified In an exploratory study conducted to determine knowledge 
and attitudes toward family planning in the Guanajato project area. 
In the course of some of the Family Education training programs, 
women had expressed interest in knowing more about methods for 
"limiting the number of children." The Research Department was asked 
to design a study which would give some indication of knowledge of and 
attitudes toward methods for controlling family size. Interviews were 
conducted with 30 women who participated In training programs In two 
rural communities. Another 17 interviews were conducted with women and 
their husbands, so that data on households were collected. Results 
Indicated that parents prefer smaller families but have little knowl- 
edge of orthodox ant i -concept ion measures, except for the pill. Most 
couples had given little thought to family size before marriage. The 
parents of larger families were more Inclined to accept family planning 
information. The research report concluded that a program of family 
planning and education wou)d probably be well received in that area. 
It suggested that such a program should give special attention to 
reaching men, whose attitudes toward family planning are generally 
less favorable than women's. The report recommended that PCP contact 
the Office of Health Assistance (OHA) , which has a division 
responsible for family planning Information and Is the appropriate 
institution to conduct such a program in rural communities. 

In addition to the OHA, the report was sent to other institu- 
tions and government agencies for whom the findings would be relevant, 
Including the National Institute for the Protection of Infants and 
the Mexican Foundation for Population Studies. To date, there Is no 
Indication that the OHA took any action on the report. It is difficult 
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for an Institution such as PCP to stimulate Institutional action that 
falls outside of its own purview. 

2. Evaluation of Training Programs . A second kind of 
research deals with the short-term effects of the training program. 
Typically, participants are measured on attitudlnal and knowledge 
items at the beginning of the course and again at the end, and the 
amount of attitude change and knowledge gain as a consequence of course 
participation can be calculated. As a consequence of the research 
findings, recommendations can be made regarding modifications of 
course conduct and materials. 

An example of this kind of research is provided in a longitudi- 
nal evaluation conducted on a training program dealing with the 
economics of credit, conducted in the La Begona, Guanajato, area of 
the project. Thirty-six interviews were conducted the day before the 
pilot course began and 39 on the last day of the course, of which 2k 
people appeared in both the "pre" and "post" samples. The majority 
of participants was over 25 years of age. The most striking research 
outcome was the finding that although $0% of the participants claimed 
to be members of the local credit society, there was a general lack of 
knowledge about what it meant to belong to a credit society and about 
how such societies functioned. Furthermore, it was found that the 
training program itself produced only relatively small knowledge gains 
related to credit societies. It was concluded that most farmers have 
only a nominal membership in the credit society with little under- 
standing of or commitment to the work and goals of the society. The 
research report recommended that training courses not be given unless 
they be conducted In closer colaboration with credit-related agencies. 

Partially as a result of these findings, PCP developed a Joint 
project with one of the two official banks in the area, the Central 
Agricultural Bank, S.A. (BACSA) , for a cooperative training program. 
BACSA assigned two bank agronomists to work with two PCP technicians 
as a training team to conduct courses on use of credit in the com- 
munities. Supervision of the training activities remained the 
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responsibility of PCP's training department. In the evaluation of a 
course conducted ^jointly by the BACSA-PCP team, a statistically 
significant increlase was found in knowledge levels about availability 
and use of credil. Several explanations were offered! 

a. The direct participation of the agency that actually 
dispersed credit (BACAA) gave the course more 
cre«Jibl 1 Ity, and made the material more salient to 
parpcipants. 

b. The/ general organization and conduct of the second 
course appeared to be better than the first. More 
ac|urate records were maintained. Only those 
pafticipants who attended at least three of the five 
sejssions were Included in the evaluative data. 

c. Tile original pilot course represented the first time 
tLt the PCP instructor had taught that specific content 
mjaterial. He probably gained experience through the 
fjirst course and was more effective In the second. 

3. Evaluation of Training Materials . — In addition to evaluating 
the training programs, It Is also necessary to evaluate the materials 
used. One approach is through formative evaluation where Individual 
components of films, TV shows, or workbooks are pre-tested during the 
development of the material for such factors as Interest, Intelli- 
gibility, and learning. Thus before the material is ever presented 
to Its intended audience, it has been evaluated and the producer can 
have greater confidence In Its appropriateness. 

There have been some PCP research efforts that are at least 
somewhat formative In approach. For example, one study was designed 
to evaluate the use of Illustrations for training materials In a 
course on corn production costs. Twenty-eight line figure drawings. 
Illustrating concepts and activities to be presented In the course, 
were shown to a sample of 41 farmers In four communities of the 
Guanajato project area. The farmers were asked to Identify the 
elements In the pictures and to describe the actions being presented. 
Although most of the identifications were correct, the research report 
recommended that eight of the drawings be eliminated and six more be 
revl sed. 
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In the area of films, TV and radio programs, PCP was less 
successful In developing a modus operandi > whereby formative evaluation 
would be an Integral part In che production of a specific film or a 
radio or TV program. Several films, the TV series and the radio 
programs were evaluated for their effect on the Intended audience 
&fter the materials had been completed, but little was done In terms 
of evaluating and modifying program components during the productive 
stages. 

Discussion and Conclusions 
A number of conclusions or generalizations about evaluative 
research emerge from the examples we have presented from the PCP 
experience.*^ 

We note a number of potential problems which evaluative 
research faces In an action agency of non-formal education, not all of 
which are directly related to the examples we have previously pre- 
sented. 

1. Action programs may not lend themselves naturally or 
easily to the combining of theoretical Interests with evaluative 
research. The task of evaluating materials, whether In a formative or 
summatlve mode. Imposes certain limits on the research design. The 
foremost concerns of an action agency are pragmatic and the pressing 
research needs, from the agency's standpoint, deal with questions of 
design and production of training materials, and the organization and 
conduct of training programs. It may be that the theoretical interests 
of the researcher are not measurable within the data collection 
necessary to evaluate particular materials or sources. We mentioned 
earlier the constant pressure for immediate research results which the 
researcher faces In an action agency. This pressure for results may 
squeeze out theoretical considerations or make it difficult to find 
time for the more extensive analysis of data that theoretical 
considerations might demand. 

Oenztn has recommended that social researchers "should never 
enter Itito a research relationship where they lose or give up control 
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aver their own activities." This Is excellent advice, but the danger 
is that the researcher will enter an action agency, with good 
intentions on both his part and the agency's to conduct tlieoretica) 
research combined with evaluative research, but the everyday pressures 
for evaluation may cancel out the best of intentions. 

Yet It Is possible to do theoretical research within the 
context of an on-going action program. In fact, within the PCP 
research program, two M.A. theses and a Ph.D. dissertation were com- 
pleted within a three-year period. But a researcher will need to 
exert special attention, time and energy to Insure that his theoretical 
interests are built into evaluation research designs. 

a. The eventual success or failure of a training program Is 
often the consequence of pol Icy Issues which He outside the domain 
of evaluative research. The researcher in an action agency may at 
times feel frustrated because the modifications produced by findings 
of the evaluative research appear to be Insignificant compared with 
the impact that policy changes can have on a program. A training 
program for farmers may deal with the use of credit. Training materials 
may be evaluated as to accuracy, comprehenslbl 1 Ity, cultural appropriate 
ness and knowledge gain which they produce. Yet bureaucratic policies 
in a banl< or other institutions may be such that the farmer could 
know and do everything which the training program has taught him and 
still be unable to secure credit. Cases similar to this are not 
uncommon. Unfortunately there are no "all-purpose" solutions to the 
dilemma which this poses for the researcher. 

b. Another concern for the researcher is the impact which 
evaluative research makes on the action agency. To what extent are 
research recommendations accepted and Implemented? In the PCP 
experience, the effect of evaluative research appears to be limited 
to the modification of training design. To put It another way, when 
research recommends changes that might be considered "minor", and are 
within the institutional program, they stand a good chance of being 
implemented. But when changes recommended might be classified as 
"major," particularly If they suggest structural changes, the 
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IlkellhoQcl of their acceptance decreases. There is also the possi- 
bility that the action agency may use evaluative research as a public 
relations device to give the institutional programs a more scientific 
appearance. It may accept and/or publicize those findings which 
agree with its policy or make it "look good" and reject findings which 
do not agree with its institutional orientation. In part this Is a 
question of the Institution's learning to use research, as we discussed 
earlier. But it also reflects the reality that institutions operate 
within political constraints; and In the final decision-making, 
political considerations may outweigh scientific findings, to the 
great frustration of the researcher engaged In evaluation. 

2. Evaluative research can be a useful tool In the development 
of Instructional materials and modification of training programs. The 
case study we have presented Is not a perfect one, PCP Is still In the 
process of workingout Its own problems related to the utilization of 
evaluative research. Nevertheless, our examples demonstrate some 
positive consequences of evaluative research; It can increase learning 
In several ways: 

a. Evaluative research can give more accurate descriptions of 
the target learner. In terms of such variables as: age, education, 
socio-economic level, attitudes toward and knowledge of course content, 
other sources of knowledge to which the learner may be exposed such 

as the mass media, other Institutions and their educational prog>*ams. 

b. Evaluative research can assist In the development of 
Instructional materials. It can provide Important feedback data on 
clarity, level of difficulty and understanding, and appropriateness of 
the materials to the particular cultural setting of the learner* 

c. Evaluative research can assess the Impact of a particular 
training course or a series of training efforts. It can furnish 
answers, with some degree of precision, to such questions asj How 
much learning actually took place? What attitudes were changed, and 
how much? What subsequent behavioral change, as advocated by course 
content occurred? 
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3, Effective use of eva)uative research can oniy come about 
through a profound Institutional learning experience. Creating a 
research department by no means guarantees that research activities 
wD) have any Impact on the planning and development of instructional 
materials or the conduct of training programs. The curriculum, 
training and production departments have to 1 ea r.n how to use evalua- 
tion, and the research department must learn how to worl< with the other 
administrative units. For PCP, It tool< a considerable period of time 
to learn how to utilize a research department and an evaluative 
methodology. For the greater part of the first two years of PCP's 
existence, much of the evaluation could probably be described as "too 
little and too late." Cooperation among research, training and pro- 
duction departments did not come Immediately and automatically. But, 
over time, the departments began to learn how to worl< together; mutual 
respect and understanding developed, the necessary l<inds of inter- 
action began to emerge, and the value of research became evident. 

The institutional learning experience Implied some practica) 
considerat Ions : 

a. Research personnel must be involved in the early planning 
and discussion of materials, courses and programs. Particularly, the 
specification of instructional and program objectives should be the 
joint activity of curriculum, training, production and research people, 
so that all have a clear idea of the l<inds of effects that evaluation 
research is supposed to identify and measure. 

b. There must be a recognition of and planning for the 
adequate lead-time that evaluation requires. Research is always 
confronted, in its day-to-day activities, with Institutional pressure 
for immediate results. It is forced to l<eep pace with the activities 
and operations of other departments. This creates the bind where, on 
the one hand, if research operations are not swiftly carried out, 
results only become available after decisions have already been 
made. On the other hand, the research process Involved definite, 
time-consuming steps (instrument preparation, data gathering, coding, 
tabulation, analysis and interpretation) if valid results are to be 
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Insured. The necessity of lead-time Is often not recognized or under- 
stood by Institutional leadership or other staff members. The 
researcher himself may have to develop a working style that will 
balance the requirements of serious and professional evaluative 
research with the need for producing results quickly enough so that 
they represent useful feedback. 

c. An atmosphere of confidence and cooperation must be 
created between the research people and the action people. The 
Institution must come to believe that the kind of knowledge produced 
by evaluative research is essential to the Institution and that 
research costs In money, time and energy are well Invested. 

It Is easier to develop and use models of summatlve 
evaluation (research on the effectiveness of completed materials or 
courses) than it Is to develop and use models of formative evaluation 
(research aimed at testing content modules In the development stages). 
PCP curriculum training and production people were more willing to 
have their materials evaluated after the product was finished than 
they were to take time during the developmental stage to evaluate 
Individual components of the course, film radio or TV program. It 
may be that this represents some natural human resentment of any 
Interference with the creative process: creative people are sometimes 
reluctant to interrupt the creative act to assess the effectiveness 
or the relative contribution of individual components of the Instruc- 
tional product. 

While this Is understandable, it is unfortunate. Formative 
evaluation provides a methodology for Identifying precisely the 
strengths and weaknesses of particular segments of a given Instruc- 
tional material. It is much more difficult to pin-point the good 
and bad features of a TV program when the total program Is evaluated 
after the fact, than it is to evaluate individual program segments 
as the program is being developed. Furthermore, It is more economical 
In the long run to identify and correct problem segments in the 
development stages than to change the whole film, program or training 
course after it has been completed. 
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Thus, while It Is easier to conduct summatlve evaluation, 
It Is more efficient to develop an active program of formative evalua- 
tion. We should stress that the two kinds of research should not be 
considered as competing alternatives. Both have their place. 
Summatlve evaluation, to assess the overall effectiveness of Instruc- 
tional materials and programs, Is a necessary activity, but It should 
be preceded and complemented by formative research. 

Summary 

In this chapter, we have looked at a program of non-formal 
education that contained, within Its organizational structure, a 
research department. Three kinds of research were undertaken: 
baseline studies , which attempted to describe the target learner and 
his physical and social environment; formative research , which provided 
evaluation of training materials In the course of their development; 
and summatlve research , which f-rnlshed feedback of the effects of 
materials and training programs on their users. 

Several problems were noted: Action agencies are sometimes 
Impatient with the Inevitable time lag occurring between design of 
the research study and availability of research results. Producers 
of training materials are often skeptical of the value of formative 
research In helping them develop new materials. Problems of a 
political nature which lie outside the research design, often have 
more Influence on program outcomes than on modifications which 
research might suggest. 

We noted that utilization of evaluative research by an action 
agency necessitates a profound Institutional process of learning and 
adjustment. For researchers, production people and trainers to 
collaborate effectively requires trust, mutual respect and patience 
with one another. But the building of such a successful collaboration 
Is worthwhile. It can Improve the quality of work of all concerned 
and thus of the non-formal education program. It can Increase 
learning effectiveness. 
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FOOTNOTES: CHAPTER V 



This distinction was developed In Chapter IV of this 
monograph; also see "The Methodology of Evaluation" by Michael 
Scrlven, In Blaine R. Worthern and James R. Sanders, Educational 
Evaluation: Theory and Practice (Worthlngton, Ohio; Charles A. 
Jones Publishing Co., 1973). 

2 

The 'ejidatarlo' can be described as the main Intended 
beneficiary of the Agrarian Reform and the Mexican Revolution. The 
ejidatarlo receives land from the 'ejldo', a system of land tenure 
that consists basically of the restitution or outright granting of 
land to the existing peasant communities as a permanent and inalienable 
possession. The community In turn Is expected to distribute the arable 
portions of this land among (ts members and reserves the- pastures and 
woodlands for community use. The ejidatarlo cannot sell his plot, nor 
lease it but only to keep the rights of succession for his descendants. 
3 

Norman K. Oenzin, Sociological Methods (Chicago; Aldene 
Publishing Co., 1970), p. 529- 
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CHAPTER VI 



LEARNING EFHC^iV^NESS AND THE 
COMMUNICATION OF INNOVATIONS 



Wi 1 1 iam A. Herzog, Jr. 

Non-formal education and diffusion of InnoviUon, as learning 
processes, have Important convergences. Non-formal education Is con- 
cerned with a practical, applied kind of learning which Is often work 
and job related. Diffusion of Innovations deals with the process by 
which members of a social system learn about and adopt new Ideas, 
practices and products. 

N- fjrmal education may Itself be an "innovation" when, as a 
new approach to learning, it Is Introduced Into a social system. In 
such Instances, a knowledge of diffusion theory would be helpful in 
understanding the factors related to adoption of non-formal education 
by the social system. 

It is also clear that many non-formal education programs deal 
with innovations as Instructional content: farmers may be taught to 
use new seeds and fertilizers; married couples may be informed about 
contraceptive devices; industrial workers may be trained In the use of 
new tools, equipment or work routines. Innovation may be the subject 
matter of many non-formal education program*;. A knowledge of adopter 
characteristics and communication channels may help to gain more rapid 
a.-Cf:*{>tance and continued use of these Innovations. 

Both non-formal education and the diffusion of Innovations 
share a concern for the effect s of their programs: In the case of non- 
formal education we may speak of learning effectiveness ; the diffusion 
model refers to adoption . Both aim to produce behavioral change at the 
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Individual level and social change at the aggregate level. We can 
diagram the relationship of non-formal education to the diffusion of 
Innovations as follows; 



NON-FORMAL EDUCATION 

- may, Itself, be an 
Innovation 

- may promote Innovations 
In its programs 



A 



Learning Effectiveness: 

- acquisition/modification 
of knowledge and 
behavior patterns. 




4 



DIFFUSION OF INNOVATIONS 

- Innovations often diffused 
through non-formal 
education programs 



I 



I Adoption: 

M - acceptance of new Ideas 
M and practices 



Social Change: 

relevant and 
persistent 




This paper, then, directs Itself to the question: what 
principles from diffusion theory have relevance for learning effective- 
ness in non-formal education programs? Or, In terms of our diagram 
above, what do we know about adoption In the right-hand column that 
may transfer across to learning effectiveness In the left-hand column? 

Diffusion theory can be summarized In a conceptual statement: 
An innovation is communicated through channels over time to members of 
a social system (Rogers and Shoemaker, 1971 » P* 18). In attempting to 
relate diffusion theory to learning effectiveness in non-formal 
education, we will look at the characteristics of the Innovation, 
communication channel strategies, differences between kinds of 
adopters, and the role and function of change agents. 
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Characteristics of the Innovati on 
By "innovation" we mean any idea, practice or product that is 
perceived as new by a potential adopter. The concept of non'-formal 
education is basically an idea- innovation. Like most idea- innovations, 
there may be material aspects to the innovation; at some point it may 
be necessary to deal with buildings and furniture In order to carry 
out an Instructional program. But non-formal education as a concept is 
concerned with such issues as development of Instructional materials 
related to specific problem areas; adapting instructional programs to 
learner's schedules; bypassing bureaucratic requirements of currlcular 
development, supervision and accreditation. These relate primarily to 
Ideas and policies, rather than to material products. It Is worth 
noting, however, that most of the empirical research bearing on the 
diffusion of Innovations has focused on material product innovations, 
rather than idea- innovations. 

Diffusion researchers have Identified a number of character- 
istics of the innovation Itself which Influence the rate and extent 
of its adoption. The characteristics which seem to be most Important 
In predicting adoption of an innovation are relative advantage, 
compatibility, complexity, observability and trialabillty (Rogers and 
Shoemaker, I971)> 

Relative Advantage 

An individual will adopt an Idea more rapidly If that Idea 
is demonstrated to be better than his current way of doing things. 
The calculation of advantage may take Into account such factors as 
ease of operation, savings of time, reductions of cost, etc. The 
United States, for example, Is now considering the adoption of the metric 
system of weights and measurements, an Innovation which will have far 
ranging consequences for the country. Several advantages have been 
cited for adopting the metric system. The Immediate advantage has to 
do with simplified calculations of the metric system In the use of 
decimals, rather than the need for converting among feet, pounds, 
quarts as In our standard system. And there Is the more global 
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consideration that conversion to the metric system will make U.S. 
products more desirable on a world marl<et, and particularly for 
exportation to other countries where the metric system is already in 
current uso. A third advantage is that the United States would be 
contributing toward a world-wide standardization in scientific and 
technoloo :al measurement. On the other hand, Introduction of the 
metric system would have some serious disadvantages. It would entail 
a period of changeover In learning the new system where there might be 
considerable confusion. It would mean that our current U.S. practices 
and measuring Instruments would become obsolete. It would involve 
high costs In terms of implementing new equipment, changing current 
measurement systems and the recalculation in terms of metric 
measurement of our present distances, weights and similar kinds of 
measurement. In applying relative advantage to learning strategies, 
perhaps the most important point Is that relative advantage must be 
considered from a standpoint of the learner . It Is the perception of 
advantage to the learner, not to the teacher, that Is crucial. A 
nutritionist, teaching a class in meal -plann ing to a group of rural 
housewives, has no difficulty seeing the advantage of a balanced meal. 
The rural housewife may see the disadvantage of having to learn to 
cook new foods and to convince her family to eat those foods. Learning 
effectiveness, in this Instance, depends first on the nutritionist 
coming to understand the disadvantage of the Innovation that the 
housewife perceives. Second, she must convince the housewife that the 
innovation (balanced meals) has highly advantageous long range conse- 
quences for her family and, third, the nutritionist must convince her 
that the long range advantages greatly outweigh the short term dls- 
odvantages. Non-formal education often deals with practical, specific, 
job-related concerns and Innovations. To the extent this is true, 
non-formal education should represent a more efficient mode for 
demonstrating relative ::<.d vantages at the practical applied level. 
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CompatibH i ty 

An Individual will adopt the new Idea more r.-3pldly to the 
extent that It Is compatible with knowledge, beliefs, and values, that 
he already holds. For example, one of the problems with Introducing 
programmed Instruction as an educational Innovation was Its Incompati- 
bility wltH the teacher's values and his view of himself as teacher. 
It took away his role as a lecturer, as a dispenser of knowledge, and 
cast him Instead In the role of an educational resource. Many teachers 
found this Incompatible with their self-concept. 

Compatibility also relates to previous experience. Consider an 
Innovation In public health: If an Individual Is accustomed to receiv- 
ing medication by Injection, It should not be too difficult to convince 
him to adopt a new medicine that may require the same application. If, 
however, he has never had experience with a hypodermic needle, there 
may be considerable resistance to the new medicine. Innovations rarely 
represent Instances of complete compatibility or complete IncompatabI I Ity. 
In terms of learning effectiveness then, the task becomes a matter of 
Identifying those aspects of the Innovation which are most compatible 
with current practices, values and previous experiences. For example, 
to take the case of the hypodermic needle mentioned above, It might 
be pointed out to the potential adopter that receiving medicatton by 
InjecLlon is noL that much different from receiving medication orally. 

Complexity 

The complexity dimension bears a negative relation to adoption. 
That Is, to the extent that the individual perceives the innovation as 
more complex, he will be slower to adopt it. There are at least two 
Implications of this proposition for learning effectiveness. In the 
first place it is the perception of the learner not the teacher that 
counts. There are instances where agriculture extension programs pro- 
moting new fertilizers in developing countries have failed because the 
extension agent has not taken into account the complexity that the 
innovation represent»5d to the farmer. Applying the proper amount of 
fertilizer at the right time did not seem too difficult for the 
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extension agent. But for the farmer, to measure ^ut a precise 
quantity of fertilizer and apply it according to a rigorous schedule 
represented a level of complexity with which he was completely 
unfamiliar. Consequently, the fertilizer was incorrectly applied, it 
did not produce its intended effect, and the innovation failed. 
There are numerous cases of family planning programs where birth 
control procedures, seemingly simple and fool-proof to the change 
agents, were too complicated for the adopters to follow accurately 
and population programs failed. Many non-formal education programs 
work with educationally deprived groups. There is frequently a wide 
gap between the teacher's experience and the learner's experience! 
In communication terms, we speak of this as heterophily. Communication 
breakdowns are frequent in heterophi lous situations, particularly when 
a source of a message fails to take Into account that the receiver of 
the message does not bring the same background and experience in'to 
the communication situation that the source does. 

A second issue related to. complexity deals with the choice of 
communication channels. A diffusion field experiment carried out In 
Colombia by Spector and others (1963) found that radio was not as 
effective as an audio-visual presentation in securing adoption for 
more complex construction-type innovations such as building stoves or 
latrines. I^ere the implication is that selection of communication 
channels should be related to complexity of the material about the 
Innovation being presented. The verbal channel alone may be adequate 
for presenting relatively simple material but as the complexity of 
Instruction increases, the use of communication channels to carry the 
message will have to correspondingly increase. That ls» the audio and 
visual channels will have to be coupled together In order to adequately 
present the material • 

Observabi I Ity 

To the extent that the results of an innovation are visible, 
the Innovation will be more rapidly adopted by others. The results of 
some kinds of Innovations are more clearly visible (observable) than 
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of other kinds. For example, it is relatively simple to demonstrate 
to farmers that crops will grow bigger and better with fertilizer than 
without it. It is even possible to demonstrate that students will 
learn more through one instructional mode than through another. 

Because of their essentially practical nature, programs of non- 
formal education have an advantage in utilizing the observability 
dimension. The agricultural extension service has, for years, used 
demonstration farms and other kinds of demonstrations of agricultural 
techniques. Observability then has two implications for non-formal 
e'ducation programs. First, learning effectiveness would be greater 
to the extent that the results of innovation can be made visible in 
the learning situation. Second, the non-formal education program 
itself will diffuse rapidly to the extent that the program effects are 
observable to the community as a whole. 

Trialability 

An innovation will be adopted more rapidly to the extent that 
it can be experimented with on a trial basis. It is relatively easy 
for a farmer to plant a small part of his farm with a "miracle variety" 
seed and compare it with his standard practice. This works reasonably 
well with product-type material innovations. But it Is more difficult 
to "try out" non-material. Idea innovations, particularly when they 
are of an ideological nature. It is often the case with ideologies 
that "commitment" rather than "trial" is the only valid mode of 
involvement If one is to fully accept the Ideological innovation 
(Rowen, 1973)* 

Non-formal education programs often acquire the aura of 
ideologies. People come to believe in them because they offer truth, 
hope, certainty--al 1 the standard attributes of an ideological system. 
They often adopt the non-formal education program with a largely 
unquestioning commitment. The point here is that non-formal programs 
should not, be allowed to acquire the status of ideology. Literacy 
programs often acquire ideological force, which is evidenced by 
slogans such as: "Each one teach one"; and "The Year for Erradlcation 
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of )) literacy," And the results usually Indicate that the Ideology 
had some al l-too-fal 1 Ible suppositions. The use of pilot programs and 
evaluations are practical steps for protesting against the "Ideology" 
syndrome. In effect they substitute trial for commitment; or, at 
least, they attempt to Introduce some empirical bases on which to 
make the commlfmpot step. Trlalablllty can and should be a character- 
istic of non-formal programs at their Innovation stages. 

Learning Effectiveness and 
Communication Channels 

The question of communication channels was touched upon 
briefly In connection with the Issue of complexity of the Innovation. 
Some further comments may be useful. Communication researchers 
typically make a major division between communication via interpersonal 
or face-to-face channels and communication via mass media or inter- 
posed channels. They have noted that these are distinctly different 
modes and that each displays Its own characteristic strengths and 
weaknesses. 

Mass media channels have the advantage of reaching large 
heterogeneous audiences In relatively short time periods with com- 
paratively low unit cost per audience member reached. They are 
useful in presr>nting new information to the audience, in terms of 
diffusion of innovations, they create awareness about new ideas or 
Innovations. I^owever, many research studies Indicate that the mass 
media by themselves are relatively Ineffective in producing much 
change in strongly held attitudes and beliefs (DePleur, 1970, pp. 
129-135). 

The mass media are essentially one-way information channels. 
Messages flow from a mass media source of their audiences with very 
little feedback from audience to the source. 

On the other hand, interpersonal channels characteristically 
provide two-way cumitiunication. Information flows in both directions 
between source and receiver or, more correctly, participants in the 
communication situation are constantly changing roles from source to 
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receiver and back again to source. Tiius, tlie interpersonal cliannel 
facilitates raising questions, giving answers to questions, and pro- 
viding clarification of uncertaint ies--al I of which are difficult to 
deal with through mass communication channels. Interpersonal channels 
represent patterns of interpersonal influence among members of a 
social system whether it be family, business organization, or informal 
small group. The norms and values of that social system are operative 
in the communicative interaction. Because interpersonal communication 
occurs in a context of group norms and values, it is more effective 
than the mass media in modifying more strongly held attitudes, and 
beliefs. One of the basic propositions of diffusion theory holds that 
mass media channels create knowledge and awareness of the innovation, 
while interpersonal channels influence and persuade in the actual 
adoption of the innovation. 

It would follow then that an ideal diffusion strategy would 
combine the capability of mass media for reaching large audiences 
rapidly with the persuasive power of interpersonal communication in 
the group setting to produce maximum behavior change. This strategy 
has, in fact, been utilized in a number of programs of non-formal 
education, such as the Radio Farm Forum originating in Canada, later 
utilized in Australia and India. I^adio Farm Forums have, in recent 
years, been introduced in many parts of the developing world. A 
typical radio forum consists of a radio program of agricultural news 
and information transmitted from some central broadcasting station. 
In villages served by the radio station, farmers are organized into 
listening groups of 10 to 20 members. The groups meet usually on a 
weekly basis to listen to and discuss ideas which have been presented 
In the radio program. The group leader is provided with a study guide 
which suggests questions for application and implementation of the 
ideas in the particular local situation. There Is usually a feedback 
mechanism whereby questions which arise in the discussion groups can 
be referred to the program producers for clarification in subsequent 
broadcasts. The dynamics of the learning situation combine an 
information input from the mass media with interpersonal communication 



00321 



in a setting where group norms and values may lead to a decision to 
adopt. Of course» there is also the possibility that group pressure 
may lead to a decision not to adopt. But the group setting facilitates 
dealing with such questions as: Would the innovation be useful to us? 
How would it affect our present activities? What would it cost? What 
is the likelihood of failure? How would we go about Implementing it 
for ourselves? 

Research conducted on the' Farm Forums in India indicated that 
the effectiveness of the program \j/as much greater for those farmers who 
listened and participated in groups^than for farmers in villages where, 
lacking forums, listening was a solitary experience and occurred in 
individual homes (Schramm, pp. ISS'IS^)* The experience of discussing 
new information in a peer group setting produced both greater internali- 
zation of the program content and group support to put the innovations 
into practice. 

The combination of radio and the listening groups has been 
effectively utilized in programs of general adult basic education, 
particularly in Latin America. The prototype and best known of these 
programs is Radio Sutatenza in Colombia. The program was initiated in 
19^7 under the control of the Roman Catholic Church with some financial 
support from the government of Colombia (Torres and Corredor, I96I). 
The original aim of Radio Sutatenza was to provide literacy training 
for rural areas, but it has enlarged^its programming to include 
agriculture information, health news, religious instruction, classical 
and popular music. A similar program was developed in Brazil in the 
early I960's known as Movimiento de Educa^ao de Base (ME6) or Basic 
Education Movement. At the zenith of the program in 1963, MEB was 
operating nineteen broadcasting stations mainly in the northeast of 
Brazil with 5500 listening groups and 111,000 students. The programs 
dealt with literacy training, information about improved living habits, 
principles of community organization and cooperation, and promoted 
the development of a popular culture. This type of activity was 
viewed as too radical after the military takeover in 1964, and since 
then MEB's activities have been greatly reduced (Herzog, 1967)* 
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BEST COPY AVAILABLE 



In summary, the combination of radio programs and discussion 
groups has produced effective learning and behavior change In a 
number of areas of non-formal education: agriculture extension, 
literacy training, health and nutrition, and community organization 
and development. 



Learning Effectiveness and Kinds of Adopters 
Much of the diffusion research has focused on identifying the 
characteristics of adopters in order to differentiate those who are 
early to adopt from those who adopt later. Measured on the basis of 
time of adoption, individuals have been characterized as Innovators, 
early adopters, early majority, late majority and laggards.' It has 
been observed in many diffusion research studies that, when individual 
adopters in a social system are plotted according to time of adoption, 
the distribution approaches a normal curve* The standard deviations 
of the normal curve provide a statistical basis for categorizing 
adopters according to time of adoption. 
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Innovators are the first members of a social system to adopt 
a new Idea of practice. They are "mavericks" by nature and less con- 
strained by system norms for maintaining the status quo . They are 
sometimes referred to as marginal members of the society and often have 
weak ties to the social system. They are usually cosmpollte oriented 
more towards the outside world than their own Immediate environment. 
They tend to make use of Interpersonal and mass communication channels 
which put them In contact with new Ideas outside of their own social 
system. The next type, on the time dimension, Is the early adopter . 
He, typically, has better than average resources and makes extensive 
use of the mass communication channels. The basic difference between 
innovators and early adopters. In an Ideal sense. Is that, whereas the 
innovator has a cosmopolite orientation with strong ties outside his 
own social system, the early adopter is local lyoriented. He respects 
the norms of his social system. He Is often an opinion leader. 
Because he is more highly regarded and influential with other members 
of the system, he Is frequently sought out by change agents as one 
to "model" the Innovation. By contrast, the innovator is usually not 
influential in the community because of his disregard for community 
norms. The distinction between innovator and early adopter is best 
expressed by labeling the innovator as "venturesome" and the early 
adopter as "respectable." 

In the middle of the adopter distribution are the early 
majority and late majority categories. An Important characteristic of 
the early majority Is that, while he does adopt ahead of the average 
time for the system, he takes longer to consider the innovation and 
make up his mind than the early adopter. He is rarely an opinion 
leader, but may make extensive use of Interpersonal communication 
channels to discuss the innovation with others. A one**word description 
of the early majority type would be "deliberate." The late majority 
also takes longer to make up his mind and does so with more 
resistance to new ideas. In fact, he adopts the Innovation only 
after it has become a community norm to do so. Where the innovator 
adopts in spite of group pressure, the late majority adopts in 
response to such pressure. He can be termed "skeptical." 
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The fifth and final group Is the laggard type. He Is the last 
to adopt and, Indeed, may never adopt the Innovation. His behavior 
has little Influence on other members of the social system. Just as 
the Innovator Is out of step by adopting too soon, the laggard Is 
deviant from the system by adopting too late or not at all. The 
laggard is conspicuous for few contacts outside of the social system 
and comparatively little use of mass communication channels. The 
laggard Is the "traditional." 

Research shows that adopter types differ In terms of the com- 
munication channels they use to receive information. Earlier adopters 
In all fields tend to watch more television, listen to more radio 
programs and read more newspapers, magazines and books than do late 
adopters. And within the local system, it Is more characteristic of 
earlier adc.ters than later adopters to engage in interpersonal com- 
munication about the innovation with friends, neighbors, and col leagues. 
Earlier adopters are more inclined to seek out information and to have 
greater knowledge of the Innovation than later adopters. 

Many non-formal education programs deal with overtly behavioral 
goals. They aim at teaching new techniques or introducing new products, 
materials, technologies, which imply an Immediate behavioral step. 
The objective Is that the learner will go out and put Into practice 
in the real world that which he has studied theoretically In the 
learning situation. A main difference between formal and non-formal 
learning Is that. In the non-formal mode, the gap between learning 
and application is much smaller, both in time and space. 

What, then, does this say about applying a typology of adopters 
to learning effectiveness? First, we can predict that. If left to 
themselves to convert theory Into practice, learners will tend to 
distribute themselves according to the normal curve: there will be 
some innovators, early adopters, then the later types followed by the 
laggards. In other words, learning does not automatically lead to 
Immediate adoption. The diffusion model suggests that there can be 
considerable slippage between learning and practice and. In fact, 
some may never make the final step of adoption. 
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What can be done to reduce the time lag implied by the 
adoption curve? One proposition implied in the diffusion research is 
that learning will be more rapidly followed by adoption of the practice 
as the learning situation more closely approximates the rea) )ife 
situation. When the learning situation demonstrates the relative 
advantage of the new Idea, allays fears about Its complexity, shows 
its compatibility with current practice, and makes it observable In a 
trial situation, we can predict more rapid adoption. These character- 
istics are nrast effectively demonstrated in terms of the learner's 
own life experience. All of this makes a strong case for on-the-job 
training and making the learning situation as much like the job or 
application settlng^as possible. One of the real strengths of non- 
formal education is Its potential capacity for deriving new strategies 
for reducing the gap between learning situation and real-life 
appi I cat ion. 

Learning Effectiveness and the Change Agent 
A key actor in the diffusion process is the change agent , that 
member of a change agency who works directly with the client system to 
secure the adoption of the change agency's Innovations. Agricultural 
extension services employ "county agents" or "extension agents," 
family planning programs have their paramedics. Pharmaceutical houses 
use "detail men" who visit medical doctors to Introduce them to their 
company's latest drugs and medicines. In education, teachers are 
intended to function as change agents. (Obviously this is not always 
the case, since many educational systems are resistant to innovation 
and too often teachers function principally to maintain the status 
quo.) 

But assuming that In non-formal education the teacher or 
instructional technician can be regarded as a change agent, the 
diffusion model provides some Interesting perspectives on this person 
and his role. The change agent can be viewed as the link between two 
systems, the change agency and the client system: 
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As Hnk between, he must identify with and relate to both 
systems. As representative of the change agency, he reflects the 
values and goals of his employer. But to be effective in the client 
system, he must understand the values and goals of that system. Yet 
the values and goals of the two systems are rarely identical and 
herein lies the dilemma of the change agent: how to effectively 
advance the goals of the change agency yet maintain the trust of the 
clients, when values and goals of the two systems are in conflict? 

Rogers and Shoemaker summarize a number of diffusion studies 
with the proposition that "change agent success is positively related 
to homophily with clients" (1971, p. 2i»2). Homophily refers to degree 
of likeness between change agent and (members of the client system: 
the extent to which he is like them (and able to identify with them) 
on such variables as social status, age, education, cosmopol iteness. 
Yet there is a sense in which the change agent cannot become entirely 
conformed to the client system or he loses his effectiveness as change 
agent. He represents a level of knowledge and expertise which the 
client does not have, otherwise there is no change which he can bring 
to the client. If he Identifies too completely with the client, he 
may lose his capacity to function as a representative of the change 
agency. So the change agent may find himself in a state of ambiguity 
and tension (hopefully a creative tension), produced by conflicting 
needs, values and goals of two different systems. 

Probably the most critical function which the change agent 
serves is that of communicative link between the two systems. From the 
change agency to the client system he carries information about innova" 
tions, technical specifications for new practices and procedures, some- 
times a whole new approach for a problem area. But he also fulfills a 
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feedback function in communicating client system needs to tlie change 
agency and in reporting bacl< to the change agency the effectiveness of 
the change program. Thus the diffusion perspective defines the change 
agent as foremost a communicator, with the requirement that he l<eep 
communication flowing In both directions. 

Non-formal education programs have verified the relevance of 
these principles. In "animation programs" of rural development in 
Senegal, promising individuals were selected out of villages, taken 
to training sites for short periods (three days to two weeks), and 
given intensive training in identifying and dealing with village 
problems (Hapwood, \S(>k), The goal of the animation program was to 
produce a change agent who had technical competence, but who maintained 
a high level of homophlly with the village. He had the expertise to 
help his client, but he remained one of them. In Northeast Brazil, a 
literacy program Cruzada ABC, used 15-year old volunteer teachers from 
the community who had only a primary education and gave them Intensive 
training as literacy teachers (Real Idade, I966). They were effective 
because they knew the community, and the students in the literacy 
classes knew them. 

The principle of homophlly applied to change agents Is a 
special case of the general rule that communication Is more effective 
among individuals who are more alike, it suggests that homophlly 
between teacher and student Is a necessary ingredient for learning 
effect I veness. 

Summary 

In this chapter we have attempted to demonstrate the 
applicability of diffusion theory as It applies to learning effective- 
ness in the non-formal mode. We described the diffusion process as an 
innovation communicated through certain channels over time among 
members of a social system . We noted characteristics of the Innovation 
which affect the rate of Its adoption by members of a social system: 
relative advantage, compattbtl ity, complexity, tr lalabt 1 ity, and 
observability. We discussed advantages and disadvantages of both mass 
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and Interpersonal communication channels, and suggested strategies for 
combining Interpersonal and mass communication to diffuse Information 
about Innovations so as to maximize adoption of the Innovation. We 
further noted that Individual members of a social system can be 
classified according to the relative earllness or lateness with which 
they adopt an Innovation as It enters the social system. The adopter 
types are: Innovators, early adopters, early majority, late majority 
and laggards. Finally, we specified the role of the change agent as 
communication link between the change agent and client system. Each 
of these aspects of the diffusion model was discussed In terms of Its 
relevance for learning effectiveness and applicability to non-formal 
education. 
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FOOTNOTES? CHAPTER VI 



The diffusion research on adopter categories has been 
summarized by Rogers and Shoemaker, 1971, pp. 17^-196. This section 
is based, in part, on their summary. 

2 

From Rogers and Shoemaker, 1971 » p. 182. 
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THE CASE OF THE DISAPPEARING DISTINCTION! 
FORMAL AND NON FORMAL EDUCATION IN CHINA 



F. Donald Sawyer 
and 
Ted Ward 

Large-scale social experiments fascinate scholars. Historians 
point to periods of fundamental change In the direction of human 
development. Sociologists point to incursions of government into 
causes of human welfare. Educators point to restructuring of the roles 
of schooling in a society. Today the eyes of all of these and others 
are focused on China. During a century begun in the dimness of a 
medieval veil, subsequently clouded by war and obscured by the confusion 
of revolution and by the blinding ostracism of other great powers, a 
"new" nation has emerged: the largest in the world. China, rich in 
the traditions of its own persistent past, yet dazzling in its 
capability of selectively breaking with what it sees as the inhibi- 
tions among those traditions, is very much a reality and very much 
with us. 

Motivated in large measure by curiosity, some by fear and 
anxiety and some by a deep need to rebut and denounce, scholars are 
attempting to make up for the decades of dimness, the century of 
neglect. To China! 

Certainly there are dangers and potentialities for profound 
misunderstanding. We lack a history of continuous informational 
Involvement, much less scholarly interaction with China. It ts easy 
to read too much into the newly available bits and pieces of data. 
We don't yet know the credibility of sources. We cannot see the total 
context which gives the information more full meaning. Thus we 
proceed with caution. 

The rapidly increasing documentary information from European, 
American, and Oriental sources coupled with the still rare but now 

32^ 



ERIC 



325 



available first-hand scholarly observations within China make possible 
a responsible use of China as an Illustration, at least. Early In the 
development of this monograph a colleague returned from a sojourn of 
several months with his brothe. . a cadre In Fuklen Province. Though 
the Interpretations and conclusions are those of the authors, the 
value of Dr. Joseph J. Lee's Information Is gratefully acknowledged. 

The Distinction Between Formal and 
Non-Formal Education 

Worldwide, education Is changing. Purposesi techniques, and 
institutional forms are changing. Educational reform Is In the center 
of public attention In many countries. Formal Institutions are being 
challenged to reduce costs while providing more diversified services 
to a greater number of people. As a result. Innovation is a major 
theme. Innovation Is occurring not only In formal education, but to 
an increasing extent It is also stimulating the expansion of non- 
formal education. There has been an Increased awareness that hon- 
formal modes of education hold great promise, for the developing 
countries as well as for the developed ones. Along with promises, 
there seem always to be some problems. To get a balanced picture of 
the new Interest In non"formal education, one must look at both the 
problems and the promises. 

"Non-formal education" Is a negative descriptor, and thus It 
says less than the term "formal education." (It Is like describing an 
automobile by saying It Is a non-horse, non-atrplane, non-boat, etc.). 
Often "non-formal" has been understood by the layman as being without 
form or discernable structure, organization, or purpose. "Formal" on 
the other hand connotes procedure, purpose, form, and order. Yet 
almost all of education— not Just formal schools— In the community, 
the home, church. Industry, and other social institutions and business 
organizations have form. If a distinction Is to be drawn It had best 
be between "schooling" and "other than schooling." The term "schooling" 
is even more descriptive than "formal education" to denote the 
particular sort of education provided by the educational establishments. 
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Non-formal education usually Indicates that sort of education that Is 
••non-school." Indeed the Issue Is "non-school" rather than "without 
form." The distinction then is not the matter of "form" versus 
••formless"; rather it Is non-formal agencies as distinct from the 
formal agencies and institutions. 

Formal agencies are given over to education as thelf primary 
purpose; non-formal education is more apt to be seen as a means to an 
end. Usually non-formal education focuses on Improvement of social 
and personal living, occupational capability, and vocational com- 
petency. In large-scale planned societies education has worth in 
terms of its contribution to the state or to the whole society, 
rather than to Individuals. In these emphases, education is not the 
goal; it is rather the means to the goal. Education is of concern 
because of what it can and will do for the learner or the society 
rather than for any intrinsic value. It is of value only as it can 
help the student to make changes in himself and his environment in 
accord with his goals or the goals of the society. 

Formal education has come to be seen as having intrinsic 
value In most modern societies; whereas non-formal education In modern 
as well as developing societies Is almost always seen to have 
functional or practical value In terms of the utility of the learning 
it produces. 

"Formal" and "non-formal" can also refer to the administrative 
structure and style of the educational effort--or even the arbitrary 
labeling of the management or sponsor. A family-planning program 
differs from a primary school on the basis of administration and mode 
of delivery. The family-planning program Is non-formal education and 
the primary school Is formal. Yet both are in a baste sense formal 
and institutionalized. The military services teach basic mathematics, 
and so do primary schools. Because of the lack of label "school" on 
the former. It is non-formal education, while the primary school is 
forma I . 

By using the above understanding of non-formal education, we 
can see that the military services, youth corps operations, agricul- 
tural extension and the like are all concerned with non-formal 
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education. Indeed, they are concerned with educating, but they do 
not lack form or structure. To call them "non-formal" stretches the 
language quite far. It might be more precise to call them "non- 
school." Here we are again In semantic difficulty because they may 
call their educative operations "schools." 

Yet the key to understanding the uniqueness and dynamism of 
the Chinese educational system lies precisely In this matter of 
definition and separiatlon. The People's Republic of China has not 
allowed Itself to be bound by semantics or traditional segmentation. 
Instead It has Integrated the diverse facets of non-formal and formal 
education with the realities of Its social and economic situation to 
create a vast social and educational movement that Is truly staggering 
In Its objectives and revolutionary In Its methodology. 

Educational Transformation In China 
Throughout the history of the Chinese Communist movement Mao 
Tse-tung's basic goal for education has been stunning In Its scope: 
the total psychological remaking of the entire Chinese population Into 
"new socialist men" so as to create and effect a program of economic 
and social development that Is at once revolutionary, Marxist, and 
uniquely Chinese In character. Moreover, to the astonishment of 
opponents within China and critics outside, the Chinese educational 
system appears to be approaching, though often haltingly and not 
without setbacks and failure, this seemingly Impossible objective. 

Education in China Is complex. It cannot properly be evaluated 
apart from the Ideological and organizational currents of the larger 
Chinese social experiment. It is apparent that the remarkable trans- 
formation of the Chinese society which has occurred over the past two 
decades has been accomplished not only through the schools, which 
enroll less than one-seventh of the population, but also through a non- 
formal educational system that Is one of the most extensive, elaborate, 
and effective In the world. Whereas In most developed countries the 
formal educational structure can usually, and Justifiably, be regarded 
as the primary institution for the transmission of skills and culture 
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not otherwise obtained through informal socialization, in China it is 
not primarily given to the schools to carry out these responsibilities. 

The most revolutionary and original aspect of the Chinese 
educational system is neither the formal nor non-formal sectors but 
the integration of the two In a dynamic, process-ior iented pr,ogram 
of mass education. China has been moving toward a new natlonal-scope 
model of education that defies labels, using non-formal methods In its 
schools and employing formal pedagogical techniques in its non-formal 
programs to such an extent that the distinctions become blurred and 
the divisions become largely meaningless. 

Can an educational process which in 1958 (when illiteracy was 
estimated at more than 60^) involved an incredible 965^ of the adult 
population in some form of training for political participation be 
viewed as merely non-formal?' Is a social educational system which 
Involves at least two-thirds of China's adults in regularly scheduled 
(most at least dally) face-to-face small group discussions of centrally 
generated messages with a recognized opinion leader (cadre) be 
regarded as non-formal? Considering the status of China's transporta- 
tion and coinmunication system and her immense size, can the educational 
Implications of a system that can reach virtually every man, woman and 
child with any given message be lightly regarded? On the other hand, 
can a school system which Insists that its participants, from kinder- 
garten students to college professors, combine theory and practice by 
engaging In productive labor for 10 to 20% of their schedule and which 
often has schools operating in factories and communes run by the 
workers themselves be regarded as formal education? Is an educational 
system which (I) is avowedly non-elitist, (2) does not select Its 
students through compettttva entrance exams but on the basis of peer 
group recommendation, social consciousness, and dedication, (3) usually 
does not even issue credentials to Its graduates, and (k) whose 
pedagogy relies primarily on the creativity of the participants In 
investigating, comprehending, evaluating, and changing their Immediate 
environment, formal or non-formal? Obviously, the criteria we generally 
use to distinguish the two are largely Inapplicable to the emerging 
situation In China. 
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This paper, then, will not attempt to delineate artificial 
divisions but rather to convery a general and often speculatory 
Impression of the overall Chinese educational system. It will attempt 
to very briefly summarize the historical and social development of the 
current Chinese system, describe Its operation, .then treat lightly 
some possible explanations for Its apparent effectiveness. Finally, 
In conclusion, some of the International Implications of this model, 
particularly In regard to the question of whether and to what extent 
the Chinese model Is applicable to other less developed countries, 
will be discussed. 

Red versus Expert; Educational Development 
~ in China Under the Communists 

Traditionally, formal education in China was geared to the 
successful completion of the Imperial Civil Service Exams and was con- 
cerned with memorization, conformity, and emulation. Committing to 
memory hundreds of pages from the classics and learning to Imitate 
elaborate and ancient literary styles took a minimum of ten year's 
Intensive (and expensive) study and thus eliminated from contention 
for government positions any but children of the scholar-gentry ruling 
class. With but few exceptions, the 30% of China's population who made 
up the peasantry were deprived of access to the learning necessary to 
pass the exams, though the exams were theoretically open to all. The 
common people obtained only the Informal, practical education passed 
on from generation to generation. Taking Into consideration that this 
system of elitist education remained Intact for nearly 2000 years, the 
transformation under the Communists becomes even more remarkable. As 
Marilyn TInsman puts It, 

(over the past century] . . . China's education sector has 
taken a 180° turn, from a system of mainly private tutoring 
for the privileged society, devoted to studying classics of 
the past, to mass education favoring the peasants and workers 
and concentrating upon an uncertain future where science and 
technology are to figure heavily. 2 
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Whi)e the extent of this change and its social impact cannot be 
over-emphasized, it should be noted that Mao, being a classical schdar 
as well as a modern revolutionary, can find Confucian as well as 
Marxist substantiation for his belief In the unlimited capacity of men 
to re-educate themselves. Both Confuclous and Mencius held that the 
primary differences In men were attributable to environmental dis- 
parities, while "by nature men are the same, through practice they 
came to be different,"^ Mao believes that while a 

man's consciousness Is shaped. In the first Instance, by his 
material environment, . , , he Is naturally endowed with the 
rational capacity to formulate ideas which, when put Into 
practice, can change that environment , , , . The function of 
education, then. Is to provide the Intellectual and technical 
tools that will allow man to unite theory and practice 
effectively and contribute to the historic process leading 
towards Socialism and ComniUnism.^ 

By this definition, the educational process, while designed to create 

a Socialist society, must be dependent on and arise from local needs 

and conditions so that the people, through mass mobilization and 

participation, can change their world and thereby change themselves. 

The transition from Imperial exams to post-Cultural 
Revolution mass education did not occur In a vacuum • It was accom- 
plished only after revolution, civil war, continuous experimentation, 
and strong opposition within the Communist Party Itself. A number of 
writers have noted that the educational reforms of the Cultural 
Revolution can be traced directly to the years from 1935 to t9ii6, 
known as the Yenan period, when the Kuomlntang forced the Communists 
from their stronghold In south-central China to the border regions of 
the north. Here Mao's educational policies were, for the first time, 
seriously tested in practtcei During this period of educational trial 
and error, virtually all of the reforms later advocated by Mao and his 
supporters during the Great Leap Forward and the Cultural Revolution 
were hammered out through Intensive experimentation. 

Education In Yenan went through the same phases that were to 
be repeated later In China as a whole. Consider the situation which 
Mao's followers encountered in Yenan: after a period of almost frantic 



ERIC 



ooari8 



BEST CnPY AVAILABU 

initial growth it had become clear that formal education was being 
greeted with great 5l<epticism by the majority of the area's inhabi- 
tants, SS% of whom were illiterate and still remembered all too 
vividly the famine a decade before which had l<illed 2,800,000 people, 
one-third of the population, in Shensi Province alone. To a people 
whose life was a daily struggle for survival, mastering the Chinese 
written language seemed to be highly irrelevant to their concrete 
needs and unjustifiable in terms of the time and energy required. 
Instead of seeking guidelines for educational reform by listening 
to the people and considering their perceived concerns, planners of 
the Regional Department of Education decided that the problem was a 
lacl< of central planning and consolidation. As a result they 
instituted a plan for accountability and standardization of the school 
system that almjst proved disastrous. 

When they [education planners] sought standards on which to 
base improvement in the jrder Region schools, they drew on 
their own urban experience. They tried to mal<e schools in 
rural North-West China conform to the standards of those in 
Shanghai which, in turn, were copies of schools in industrial- 
ized Western countries. The result was a programme so 
obviously inappropriate, it provided a mandate for radical 
change.^ 

The effects were vitrually identical to those of later 
centralist or "elitist" periods in Chinese education during the first 
Soviet-styled five year plan and again after the failure of the Great 
Leap Forward in the early 60's. Basically, the teachers became a 
professional elite removed from the concerns or labor of the masses 
while students, selected on the basis of competitive academic exams 
which favored children of the old ruling class, also became an elite 
without social or class consciousness. The curriculum became increas- 
ingly abstract and irrelevant to the actual needs of the masses. 
Control became centralized and teachers and administrators were not 
accountable to the people of their community but to higher level 
bureaucrats while rural schools were ph;)sed out and consolidated with 
"healthy" urban central schools. The effect on the student makeup can 
be easily imagined— the vast majority came from the families of land- 
lords, urban-dwellers, and the old intelligentsia. 
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Reaction was not long in coming. In 1942-43, only two years 
after the standardization policies were issued, criticism was leveled 
at tliese policies which eventually led to a new, decentralized system 
of mass education based on a new interpretation of Mao's statement 
that^ Chinese education should be "natjonal, scientific and mass." 
"National" now meant a rejection of Western models developed from 
different economic conditions and designed to promulgate an elitist, 
capitalistic socio-economic system. The new Chinese education would 
be indigenous and stem from truly Chinese conditions. "Scientific" 
meant that it would be determined by empirical means, by systematic 
investigation of actual conditions and thereby devoting itself to 
arriving at new ways of solving concrete problems. "Mass" meant that 
the new Chinese education would be addressed to problems which masses 
considered important and which would elicit their voluntary participa- 
tion. The policies of the earlier Yenan period had failed not from a 
lack of standardization but from a lack of faith in and contact with 
the masses. Now the masses were to be involved in every facet of 
educational decision making. "From the masses to the masses" became 
the mass line slogan. Mandatory work-study schools, the abolishing of 
old entrance exams and favoring instead those who stood to benefit the 
most and contribute the most, and extensive decentralization of control 
and policy implementation to insure that schools would better serve the 
local needs were some of the results of these new policies based on the 
"mass 1 ine." 

As already mentioned, the struggles of the Yenan period were 
to be repeated on a national scale until the mass line finally re- 
emerged triumphant with the conclusion of the Cultural Revolution. The 
intervening 25 years saw repeated vacillation between Mao's "Red" line 
of overall social development and the "expert" or Soviet line of hts 
opponents, most notably Ltu Shao-chi. From the beginning Mao has 
rejected both the Soviet "revisionist" and Western capitalist linear 
models of economic development based on heavy Industry that extracts 
from the rural sector to develop the urban. Mao believes this places 
a heavy burden on the peasantry while providing better conditions and 
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greater rewards for the factory workers and managerial class. Instead 
he has formulated a model of economic development designed to meet 
China's national needs based on the decentralization of government 
and economy, the equalization of wealth, the principles of cooperation 
and sacrl*fice for the common good, and designed to«develop both the 
urban and rural sectors simultaneously. In finding unique solutions 
to China's unique problems, Mao Is trying to create a dynamic, popular 
process of social development which "comes from the masses and serves 
the masses"; avoids individualism, over-urbanization, consumerism and 
centralism, and which is free from political or economic elites 
motivated by personal aspirations. 
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Opposing this Red line were the experts, or In Maoist terms 
the revisionists, who favored development along the Soviet lines of 
the first five-year plan. This position sacrificed political purity 
for efficiency and Increased production. It emphasized centralism, 
••revolution from the top down,'^ and the development of Intellectual 
and managerial el Ites. 

Educationally these same lines were drawn In that the educa- 
tional policies of each faction reflected their larger priorities and 
philosophies. For example, the Red educational line favored training 
students on the basis of their class origin and political consciousness 
so as to avoid the creation of an Intelligentsia, while the experts 
encouraged entrance to schools on a competitive and strictly academic 
basis. The experts generally opposed manual labor for upper echelon 
students, while Mao insisted upon it for all. At stake was the 
question of whose general philosophy would dominate, thus determining 
the educational model and influencing the new crop of political 
leaders. If the expert line were successful, they would be Party 
trained, elite cadres. If Mao^s policies triumphed, the new leaders 
would be products of class struggle. Chronologically, the Red vs. 
expert conflict can be separated into these general periods. 

19^9-1955: Soviet centralism, Kao Kang dominant 

1955-I957S Partial decentralization to the provincial level. 
Mao influential but not yet dominant. 

I958-I96OJ Great Leap Forward. Total decentralization with 
Mao in command. 

1960-1965$ Reemergence of centralism. Liu in power. Mao 
ascending towards end of period. 

1966-1968: Cultural Revolution. Mao becomes dominant. 

Destruction of the central Party structure. 
Schools closed. 

1968——} Post-Cultural Revolution 

While the fight between the two factions to control the schools 
paralleled the struggle in other facets of society, as already 
mentioned, the educational battle was regarded as being especially 
cr It leal . 
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The Importance attached by the Chinese Communists to Ideology 
Is reflected In their acute concern with education, because 
education Is the Instrument for Inculcating the Ideology Into 
the minds and hearts of the people, particularly the young. 
. . . Thus It can be said that whoever controls the schools 
determines the character of the "successor generation." As 
the political struggle became more acute, the tissue of who 
controlled the schools became critical. 7 

For the first years after the Revolution the educational 
policies reflected the conservative policies of the Soviet-backed 
first five-year plan. By 1955 only 28% of China's college or unl- 
verslty students were from peasant or worker backgrounds, and this 
period also saw a similar growth of elitism In the Party Itself. 
Partially In response to this situation, Mao initiated the Hundred 
Flowers Campaign by mobilizing the students to criticize the revision- 
ist tendencies within the Party. Criticism, however, emanated not 
only from the left as Mao had anticipated, but from the right as well. 
They criticized the work-study programs, political control of the 
universities, collectivization, the favoring of students from peasant 
and worker families, and practically every other aspect of the Party's 
policies. The criticism of the Party cadre elite Mao welcomed, but 
the appearance of such elitism among the students themselves In 
criticizing the fundamental tenets of socialism convinced him that 
"the existing education system was undermining the revolution." 
He quickly laid plans to make radical alterations. 

First Mao introduced the "hs la-fan" movement where thousands, 
of students were "sent down" to the countryside to learn class con- 
sciousness and humility from the peasantry. He then proceeded with one 
of the most ambitious social programs ever undertaken, the Great Leap.^ 
Forward, which was designed to stave off the stagnation he saw 
developing and to meet China's pressing social as well as economic 
needs. 

The accomplishments of the short-lived Great Leap Forward in 
the area of education were dramatic. Enrollment procedures were 
democratized until by late I960, 66.8% of Peking University students 
were from peasant and worker backgrounds. Schools were redesigned 
along Yenan lines to produce "new socialist men" and were changed from 
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"bourgeois havens" Into revolutionary environments. The new educa- 
tional system differed radically from both the Soviet and Anglo- 
American education systems--worl<-study became prominent again, and 
students participated In building dams, buildings, and other public 
works across China. The result was new dedication on the part of 
the students. They felt that the Party was finally Implementing 
their stated ideals, and the same students who only months before 
had bitterly criticized the Party were swept up in this brief period 
of soaring optimism and excitement. 

The Great Leap failed. Pro-Maoists claim its demise was due 
to the treachery of the Liuists who feared this extraordinary decen- 
tralization scheme and shifted priority away from Mao's policies, but 
certainly three years of bad weather, phenomenal population growth, 
and poor organization exacerbated inherent weal<;nesses in the program. 
Then a new period of centralization ensued. By 1965 most of the Great 
Leap Forward reforms in education had been rooled bacl<, and Chinese 
education once again became hierarchical and elitist. For example, 
at Peking University by 1962, 37.7% of the students were from peasant 
and worker families. Many students, especially those from peasant 
backgrounds who lost their preferred status due to the reinstatement 
of competitive academic entrance exams, four-f this situation untenable. 
Their aspirations had been irrevocably raised, and they insisted the 
Party live up to its rhetoric. The tension and pressure built until a 
crisis was at hand. In the spring of 1966 the situation finally 
climaxed; the Great Proletarian Cultural Revolution began on the 
campus of Peking University. 

John Israel has called this upheaval "the greatest student 

movement in history" and goes on to explain the motivations and makeup 

of the young Red Guards. 

These were neittier robots or Juvenile delinquents, though 
there were elements of each, but genuinely frustrated and 
alienated young people . . . "protesting the failure of the 
revolutionary order to live up to the ideals of the Revolution. 
They were protesting the degeneration of the Communist Party 
from a lean, spartan, self-sacrificing harbinger of change to 
a complacent, avaricious, self-seeking bulwark of the status- 
quo. This, as they saw it was the road to a grey, Soviet- 
style, apparatchik-ridden bureaucratic state, and they were 
having none of it." 
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And, while "respect for the expert is familiar to the American 
experience, and it somehow seems unnatural to us that students should 
resist preparation for specialized careers,"^ such was the case among 
the idealistic and politically involved students of China. 

The result was a mass mobilization of virtually the entire 
country through the efforts of the deeply committed and highly 
politicized students in order to counter the growing elitism arising 
from Liu's centralist policies. 

Mao, of course, had not acted as merely an interested by- 
stander during the formative months of the Cultural Revolution. On 
the contrary, he had been engaged in a struggle for supremacy since 
his downfall in 1959 at the Lushan Confe'-ence where he had 
given up the Presidency to Liu Shao-chi. The Cultural Revolution was a 
culmination of that battle. It is also evident that Mao held con- 
siderable power even during the period immediately following the Great 
Leap Forward, and he was able to wield enough influence to stave off 
an outright forcible repression of the student rebellion, especially 
since his supporters controlled the army. Nonetheless, this In no 
way compromises the validity of the student uprising. Indeed Mao 
homself had no assurances as to what direction the Cultural Revolution 
would ultimately take. 

In the countryside the underlying anarchism of the student 
movement was not lost on the anti-official peasantry who rallied to 
the anti-state, power-level 1 Ing doctrines of the students. The Red 
Guards not only put Mao in control of Peking, but by October of 19^7 
had swept away the Party bosses In 26 of the 27 political districts* 
Not stopping here, this national student upheaval soon spread, 
through the students' cadre activities, among factories and farms 
welding a "new nationalism of the people." 

It is clear that the Mao line is dominant once again, and, 
despite the fact that he had to use the People's I I Herat ion Army to 
defuse the torrent of Idealistic students he had unleashed, It is 
also clear that the vast majority of students In China actively and 
woleheartedly support this line. Furthermore, If an elite should arise 
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cigain within the Party or the society at large, of if the schools 
should once again become too far removed from the people and the 
Ideals of the Revolution, those same students or their successors are 
still present, still Idealistic, and ready to mobilize once again. 

Education in China Today-The Yenan Legacy „ 

. . . Maoism is forthrightly a class ideology; it is designed 
to serve the interests of particularly the proletariat and the 
poor and lower-middle peasants. The limitations are probably 
of little concern to this group for there is not much evidence 
that they prefer the revisionist line or feel restricted by 
the Maoist line. On the contrary, Maoism is an invitation to 
play a much greater role in determining the course of their 
lives. This is the unfulfilled promise of the Yenan mass line 
which has been reasserted during the Cultural Revolution. 10 

No sector of Chinese society has felt the impact of the 
Cultural Revolution and its aftermath more than the educational struc- 
ture itself. The changes have been profound in their intent and broad 
In their effect. Mao has tried to create not a disembodied system of 
schools operating In a social vacuum but instead to transform the 
entire society into one gigantic, integrated process of education and 
re-education. The key to this bold attempt has been decentralization 
of educational control. The Party establishes basic principles that 
determine the general intent anH direction education will take by 
stipulating and promulgating sucn tenets as "our education ought to be 
proletarian, ought not to be the monopoly of a small group of society^ 
and ought not be divorced from life . . .or become the entrance way 
to power and wealth,"'' but the decisions as to how these principles 
should be put into practice are almost entirely left up to the local 
populace who implement them according to local objectives, limitations, 
problems, resources, and needs. One of the results of this massive 
decentralization and reconceptual izat ion of "education to serve the 
masses" has been the direct involvement of virtually the entire nation 
in educatipnal planning, implementation, and participation. This 
moved Ross Terrill to observe after his recent visit to China that 
"the Chinese nation is studying as if for some cosmic examination." 
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Accompanying this new involvement has been a dramatic upsurge in 

literacy (now placed at 90^, compared by the Chinese to 20-30^ In 

19't9)» and the publication of books, Journals, and local papers. 

In an article written In 1972, Khea Menzel Whitehead discusses some 

of the results of this decentralization. 

Since the Cultural Revolution, decentralization and relaxa* 
tlon of "state standards" has allowed a great deal more 
local control of schools, both urban and rural. Communist 
China has always relied heavily on private, run-by-the- 
people schools to provide supplementary school places. 
These schools have sometimes come Into conflict with 
official regulations on academic standards, school hours, 
and age requirements. Many begun during the Great Leap 
were later closed. More recently, they appear to be 
flourishing anew as factories, neighborhoods, and rural 
brigades organize their own schools. ^ 3 

Within the schools themselves, drastic changes are taking place. 
From pre-schools to universities exhortations to "unite theory and 
practice" and to "serve the working people" are manifesting themselves 
in fresh and often highly Innovative ways. Generally, these new 
policies can be seen In a renewed emphasis on productive labor-- 
sometlmes occupying as much as 50% of the students' time; a revamping 
of curricula to make them more ideologically and practically relevant; 
the consolidation and shortening of courses (which also Involves the 
revision and simplification of many texts); the virtual abolition of 
academic failure, and a new emphasis on political and class con" 
sciousness both in conLent and student selection procedures. In 
reference to this last matter It Is interesting to note that the three 
main documents forming the core of most early Ideological education In 
China were all written by Mao during the Yenan period. 

Attempts to reduce the pattern of schooling to a chart^^a 
favorite analytical tool of the West--ref lect the dilemma of those who 
attempt to describe the educational "system" that has emerged In China. 
Much simpler In purposes and Ideology than education in the West, the 
Chinese situation nevertheless demands the uses of "foggy" dotted 
lines. The Junctlure between formal and non-formal (precisely, between 
schooling and non-schooling) and the interposing of work experiences 
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as designated function of education are well illustrated in Stewart 

E. Fraser's attempt to diagram contemporary Cliinese education. 

Wliite sweeping ciianges are visible in tiie primary and middle 

(or secondary) scliools, the magnitude of cliange is perliaps most 

visible in tlie coHeges^nd universities. Possibly tiie single factor 

most indicative of the degree of change in Chinese higher education 

is the estimate that 97 to 98% of students enrolled in Chinese 

universities are from peasant and worl<er families. This contrasts 

with less ahtn 28^ in 1956. To further underscore the new mal<eup 

of the student body, Terrill found that between 70 and 30% of the 

university students were members of the Communist Party or the 

Communist Youth League. This not only indicates a high degree of 

homogeneity of political philosophy and commitment, but it also 

reflects new selection procedures as well. Before any student can 

enter a college or university, he must serve a minimum of two years 

In the army, in a factory, or on a farm. Students leaving secondary 

school are assigned to a production position on the basis of their 

interests and the national needs and must be highly recommended by 

this local production unit before being allowed to enter an institute 

of higher education. The prime criteria for selection is that the 

student be "politically sound and physically fit." In fact, if the 

person's political credentials are impressive enough, it is not even 

necessary for him to have completed middle school in order to gain 

entrance to a university. This "post (secondai'y) graduation work 

experience*' has been called "perhaps the most significant change 

which has tal<en place with regard to secondary education since the 

1 5 

Great Proletarian Cultural Revolution." The effect of these new 

policies is the avoidance of what has been called the "three door 

students, those who have gone straight from the door of the home» to 

the door of the school, to the door of the office, where they become 

bureaucrats who have little contact with real life or ordinary 
16 

people." it has also boosted the average age of college students-- 
a person must now be at least twenty years old to enter. 
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Figure 2— Education In China: Development for the Seventies' 

1. The changing nature of the Chinese educational structure renders a 
rigidly specified "school ladder" Inappropriate. Accordingly, thk* Is a 
composite diagram and provides a tentative schema only. (Stewart E. 
Praser In consultation with John N. Hawkins and S. C. Hu.) 

2. Supported and administered by the state 

3. Supported and administered by communes or factories. 

^. Schools run by factories, farms and military or political organs 
(cadre schools for I , 2 or 3 years) are not represented. 

5* Short-term schools and specialized short courses not represented. 

6. A nationwide unitary schoe* of 9 years has been proposed for ages 
7-15. 

(Source: Praser E. Stewart and John N. Hawkins, "Chinese Education: 
Revolution and Development," Phi Delta Kappan, vol, 52> no. 8, April, 
1972, p. ^91.) 
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Changes in higher education curriculum have been drastic as 
we)). Previously regarded as elite institutions with no p)ace for 
manua) )abor, a)) schools are now operating on a part-work, part- 
study basis. While students and professors alil<e spend up to $0% 
of their time outside the cUss in labor or **sharing experiences,** 
the actual form of this activity varies widely depending on the 
school, its location, the needs of the locale, and often upon the 
students' particular area of study. For example, at the same Peking 
University where the Cultural Revolution began, the girls now make 
furniture while the boys, aided by local factory workers, construct 

transistors. At the Communications University in Sian, a major wheat 

17 

center, students grow and thresh wheat. In fact, kk tons of wheat 
were produced on campus in 1970. At Sun Yat-sen University in Canton, 
professors tend vegetable gardens while many classrooms are stocked 
with local produce such as peanuts and rice. 

Integrating learning with practice often means the application 
of one's expertise to practical problems. For example. Dr. Fu, a 
biologist from the University of Minnesota, now at Sun Yat-sen 
University told Terrill that he has had to **abandon esoteric topics 
that tickle his fancy** and now heads a research project dedicated to 
the needs of Kwangtung province. In his case, this involves trying 
to develop new strains of insects to eliminate pests without harming 
the crops. 

The underlying premise behind most of the recent major currlcur 
lum changes in China is that learning through experience is both a more 
effective pedagogical technique and less likely to separate education 
from reality or students from the masses. As an example, Terrilt cites 
one university history course where the students have centered their 
attention on a coal mine in the area. One day a week for ten weeks 
each student and the professor (a Harvard graduate) worked as 
laborers in the mine. The rest of the time they spent studying the 
mine*s history. In this particular case, the class split up into 
three groups. One group investigated the history of child labor at 
the mine (and discovered that at one point children made up kO% of the 
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labor force in the mine), another traced the history of one miner and 

his family, while the last group lool<ed at the history of stril<es at 

the mine. They then read the draft of their worl< to the miners. 

According to the professor, "Meeting history in the flesh this way 

1 8 

has proved an excellent pedagogical method." 

Probably the most obvious of the curriculum changes in higher 

education has been the shortening of college programs. Generally 

speaking, university courses have been reduced from five or six years 

prior to the Cultural Revolution to two or three today. This has 

been accomplished by omitting some courseworl< entirely while combining 

other portions. At most teacher training colleges, for example, all 

teaching methods courses have been dropped and a new policy states 

"teaching methods should be guided from the classroom, not from text- 
19 

books." To help achieve this objective, students spend a large 
part of each day assisting teachers in the college lab or local com- 
munity schools. AL Sun Yat-sen University, mathematics have been 
combined with dynamics, physics, and electronics. At Peking Normal 
University ancient history has been cut back and attention placed 
primarily on the nineteenth and twentieth centuries. 

Teaching methods have shifted dramatically as well. Emphasis 
is no longer placed on lecture, memorization, and exclusively teacher 
generated activity, but on group discussion and independent study. 
Material that would have been formerly presented in the form of a 
lecture Is now generally written up by the professor and distributed 
so the actual class becomes a forum for discussion, actively involving 
the student as well as the teacher In the learning "teaching process. 
Exam policies vary but are usually open-book; they emphasize analytic 
skills, and the questions are often worked out between the students and 
teacher beforehand. The purposes of exams are as much to test the 
quality of the teacher as of the student, and as a result they "have 
lost their terror-^at least for students." It appears, too, that the 
traditional respect shown to teachers and administrators on the basis 
of status alone is also gone. Albert 1^. Yee observed that "students 
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were not In competition with each other for grades or for recognition 

as Individuals. Students and teachers work as equals In common to 

20 

help everyone achieve.'* 

An especially Interesting alteration of the university's 

function Is In the area of credent lal Ing. Though practices vary» 

21 

generally speaking neither diplomas nor grades are given at any. 

level. If a student is experiencing academic dlfflcultyi It is the 

responsibility of the teacher and the other students to see that he 
22 

Improves. Yee has noted: 

The basic criterion for student effectiveness was successful 
solution of the problem by the group, with each person being 
given the opportunity to participate* In the US, the Indl** 
vidual learner would no doubt have to go beyond group 
discussion to Indicate his own proficiency on a test. Though 
Individualized testing is not practiced there as here, I have 
no doubt that teachers and students know fairly well what 
class members are superior, average, and inferior in any 
subject. The Chinese system makes for maximum awareness of 
each other. 23 

In some colleges and universities certificates are issued which contain 

no class ranking or grade point average; instead, they include the 

comments and personal evaluations of both the teacher and the graduate's 

fellow students. With the termination of higher education, the 

graduate is then assigned to a posit ion-**usual 1y in his local region-** 

according to state need, area of preparation, and personal interest 

in a manner similar to the placing of secondary graduates* 

Cultural Revolution experimentation and innovation has also 

produced at least three new school models: the workers' colleges, 

reformed medical schools, and perhaps most important, the May 7 cadre 

schools. Workers' colleges (and peasant colleges, their rural counter** 

part) are unique in that they are directly attached to the production 

unit itself and are oriented to meeting that unit's specific needs* 

The college Is located in the actual factory or commune, and in a 

typical factory college, the students are "selected from among plan 

25 

workers with at least 12 years experience." Eighty percent of study 
time is devoted to "profession subjects"--technlca1 training relevant 
to the specific factory or commune situation. Most of the instructors 
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are technicians actually employed at the factory or commune, but they 
are also aided by outside professors and technicians who volunteer 
their time. Medical schools since the Cultural Revolution have under- 
gone radical change and are now designed to produce general ists who 
are not only physicians, but who, through their public health units, 
can also train local para'medlcs who are l<nown as "barefoot doctors." 
Though training has been cut from five years to three and subject 
matter by a third, by Integrating traditional Chinese medicine with 
modern techniques, training more para-medics, "combining practical 
experience with theoretical training" (students begin assisting in 
operations from their first year), and by phasing out the need for 

nurses, training all personnel to be general practitioners capable of 

26 

emptying bed pans as well as diagnosing illnesses, China is develop- 
ing what one group of American medical observers felt could be one 
of the finest public health systems in the world. 

The May 7 cadre schools, so named for the date Mao called for 
the turning of China into "one great school," were developed during 
the Cultural Revolution to reeducate civil servants, "professionals," 
and cadres through a pi;:ogram of manual labor and self-criticism. A 
cadre, broadly defined, is a person occupying a leadership role or 
"leading position" within any organization including the Party, army, 
state communes, factories, or schools. The stated purpose was ". . . 

to teach the cadres that they were workers serving the people and not 

27 

overlords riding rough-shod over them." Originally seen as a 
temporary part of the Cultural Revolution's general cadre/official 
reeducation program, they have now become a "permanent reeducation 
structure to prevent or inhibit revival of a bureaucratic official- 
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Initially the May 7 schools relied primarily on a sort of 
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punitive worl< system such as the hauling of nightsoil (human excrement 
used to fertilize fields) In order to humiliate arrogant cadres. Now, 
however, they are simply rural schools attended by all cadres for one 
to three years where, by interacting with and depending on the peasants 
from nearby communes, the cadres learn to respect and accept manual 
tabor while developing personal humility and a good attitude towards 
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the masses. The schools are genera) )y operated on a self-sufficient 
basis where the cadres try to produce as much food as possible. Due 
to their lack of work experience or understanding of the local condi- 
tions, they invariably must ask for help from the local commune 
members, *'and it is this recognition of their helplessness that is 

the primary lesson being taught The Chinese anticipate that 

this type of school will become a permanent part of the educational 
infrastructure. They think it will keep revolutionary ideals and elan 
alive among those who have cadre status . . . ."^^ 

Most of the above discussion on the present state of education 
in China has centered on changes within the schools. But education Is 
not limited to schools, and in China this is particularly true. In 
Mao's vision of education, every facet of life becomes a learning 
experience. Joseph Lee, who. recently returned to China after a 27 
year absence, illustrates this idea. 

In the old days education was separate from the society, from 
the community— apart from peasant life or society's activities. 
There was a special period in life when you'd go to school and 
study, and then, by the time you finished so much education, you 
had to be reintegrated into life. This is something the new 
society will not tolerate, and that is partly the reason for the 
Cultural Revolution. In the Chinese old society, and even in 
contemporary America, there was a tendency to regard education 
in a mechanistic rather than organic way, organic meaning that 
it is completely integrated. Education is not something specific 
you do at a specific time in a specific manner. Education is a 
process that can take place at any time and at any place, in 
fact, at every moment of your life, vherever you are, whatever 
you're doing. This is the organic view of education. 

Let's look at the peasants for example. In a production team 
of 20 or 30 persons the entire rice farming process is an educa- 
tional process. When to plow the field, when to plant the seeds, 
when to pump the water out of the field*"*this is all technical 
education. Members of the team do not do things mechanically. 
Each person is involved in the thinking process: what are the 
weather conditions, the soil condition and so on. Why not 
chemical fertilizer for this particular piece of land? Because 
of the alkalinity level of the soil; if chemical fertilizer were 
used it would ruin the crop and the soil. Part of the technical 
education is in the planning process because the team will sit 
down and talk about what they're going to do in the coming year, 
or next month, or next week, or tomorrow. 
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Besides technical education, the peasants are involved in 
political education regularly as well. Working in a field, 
they will take a work break. They sit down and may continue 
technical discussion, or there Is a man In the team who Is in 
charge of reading newspapers and the break may become a forum 
for discussing politics. In this situation a man is taught 
how to express himself, how to articulate his ideas, how to 
handle himself in a new situation. 30 

To facilitate this type of "organic learning," a remarkable 
degree of economic and social, as well as educationa, decentralization 
seems to have taken place. The decision on whether or not to utilize 
a new agricultural development, for example, is not made at the 
district or national level, but by the work brigade itself. Agri- 
cultural technicians are selected by the brigade on the basis of 
experience. Or. Lee's brother, for example, was selected to serve 
his brigade as an agricultural technician; he was given the position 
because of hts "rich experience" In rice farming (even though he had 
only five years of schooling). He would then attend technical meetings, 
bring back the innovations and information appropriate to the brigade's 
needs, make a report, and then, before any implementation, present the 
proposition to the entire brigade. They must decide whether or not to 
try it, if so on how much and what sort of land, etc. To rndke these 
sorts of decisions which so directly affect the individual's life, the 
peasant must gain the technical knowledge and the ability to think 
analytically and exercise good Judgment if he Is to maximize hts 
brigade's production and thus enhance his personal well being. There 
Is no abstract learning In this situation'" It all relates directly and 
Immediately to life on the most concrete and personal basts. 

Decentralization of decision-making and policy Implementation 
does not imply a lack of central input. The Chinese cadre system Is 
a highly efficient network of political representatives that penetrates 
down to the Individual peasant. Besides disseminating and extending 
Party objectives, the cadre, particularly the peasant cadre, serves as 
a source of feedback and criticism as well. They are thus Integral 
factors In implementing Mao's "mass line" policies, monitoring through 
small group interaction the attitudes, grievances, and comments of the 
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masses and conveying them, when necessary, to higher level cadres for 

policy consideration. The cadre thus represents the government to the 

masses and the masses to the government. The present use of cadres, 

reflecting the Yenan experience, is less one of propagandizing than It 

Is of explaining and Informing. The cadres. It Is emphasized, must 

serve the people and must be able to **lead the mass or accept leader- 

32 

ship from the mass."'' The Chinese Communist government Is indeed 
"a regime that rests on the masses, "^^ but the foundation Is being 
held together by the efforts of the cadres. 

The cadres, particularly the lowest level Party representatives 
being primarily discussed here, often play the extremely critical role 
of non-formal teachers. In a system dependent on commonality of 
purpose and cooperative action, the presence of highly credible Party 
representatives to explain, discuss, and coordinate policies, 
campaigns, and tactics. Is extremely Important. These homophllous 
change agents regularly reach on a face-to-face basis the great 
majority of the population. 

The cadres are especially effective In the area of political 
education where they combine word-of-mouth channels and centrally 
generated mass media messages In study sessions or media forums. 
These forums, as Indicated by Lee, usually take place at the produc- 
tion team level within the production unit and generally consist of 
around 20 members. In 1958, the Great Leap Forward period, 60% of all 
Chinese adults were engaged in this sort of continuous discussion 
forum. The study sessions examine a message, article, or news Item 
with the cadre acting as a discussion leader to disseminate, clarify, 
or reinforce the message being dealt with. Each Individual, in a 
face-to-face seminar situation with a group of his peers and the cadre, 
participates In the discussion of the items being dealt with and is 
often asked to give his personal opinions. There Is undoubtedly 
significant pressure towards conformity of interpretation, but there 
would appear to be now greater latitude (within certain limitations) 
than during the periods of centralization. The study groups now seem 
more intent on functioning as socializing agents and message 
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disseminators than "thought control" units, though to an extent this 
purpose Is undoubtedly being served too. Unrest and cadre elitism 
created by earlier attempts at exclu&'vely "top down' control has 
established a greater dependence on two way communications. The 
dally, and often several-times-dally, study groups which Involve the 
great majority of Chinese adults'* In active discussions on local 
and national Issues with peers and Party representatives Is an 
effectlve^^ and highly significant part of China's educational mass 
1 Ine. 

The mass media play an essential role In the Chinese educa- 
tional program; the learning effectiveness of the mass media Is 
enhanced through the face-to-face work of the cadres. Though recent 
figures are scarce, 1959 statistics, reflecting a similar period of 
media expansion and cultural enthusiasm. Indicates that there are 
1,811 radio stations and kO movie studios at the county level or above. 
There are also 450 newspapers and 859 periodicals published above the 
county level and hundreds of others below. This means that 15 years 
ago there were over 3,000 mass media production units engaged prl- 
mar My In propaganda dissemination.^ Furthermore, due to word-of- 
mouth multiplication, largely through study groups, China reaches more 
people per radio receiver than any other country In the world. For 
example, though the U.S. reaches 80% of its population through radio 
and China only 58%, this difference Is astonishingly small In light of 
the fact that the U.S. has nearly 60 times the number of radios per 
person. Much of this almost Incredible exposure Is due to the fact 
that over half of the receivers are linked to public loudspeakers 
erected In villages and other busy centers. Thus Chinese radio 
reaches far more ears than would be true of a situation using private 
receivers. A similar figure Is found with newspapers where China 
reaches three and a half times as many people per newspaper as does 
the U.S., though at the time these figures were released, literacy In 
China was considerably less than half that of the U.S. This coverage 
Is due to a number of factors such as the use of newspaper discussion 
groups, the posting of wall newspapers, and easy access to newspapers 
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In public libraries. Movie production and attendance have exploded 
as well. Under the Communists it was brought from a virtually non- 
existent Industry until by 1959 the average film attendance by an 
adult was 10.2, less than one-half that of the U.S. It was estimated 
In 1959 that the combined {.n'i.tt and electronic mass media could reach 
86% of China's population mtt\ any given message, a truly staggering 
figure given China's population, immense size, degree of Illiteracy, 
and level of technical development. 

While centralization of Input Is a major factor in China's 
media system, a great deal of local and traditional media are 
utilized as well. Chuyi, or story telling. Is the vocation of 50,000 
professionals and a staggering one million amateurs. These story 
tellers are usually Individuals or imall, highly mobile teams who 
spread their "morality tales" throughout China. Tatzebao, or wall 
posters, are extremely Important (the start of the Cultural Revolution 
was signalled by an overnight tatzebao campaign on the Peking Univer- 
sity campus) and have become so popular that an estimated 33 million 
were reportedly used on one national propaganda campaign. Drama groups 
are another somewhat exotic means of communication prominent In China. 
In each case, however, the discussion of the media's message and Its 
implementation Into actual practice provide one of the major dimensions 
of China's system of mass education. 

Taken together, the radical restructuring of the schools, the 
general decentralization of educational control, Increased local -level 
responsibility for decision-making, and the further utilization of non- 
formal study groups and mass media forums combine to create an 
exciting blend of the formal and non-formal education In a unique 
model of mass social education that may have considerable signifi- 
cance to other LDC's and, Indeed* educational planners all over the 
world. 
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learning Effectiveness as a Function 
of Reward Systems 

The effectiveness of Chinese education, both In its more and 
less formal phases, lies in its accurate and constant perception of 
the needs of learners. The long range concern is with identifying 
and meeting the changing needs of the people whom it serves. It has 
been concluded, through near disastrous experience, that to attempt 
to assume! or to impose a need structure or even a reward structure 
externaUy is unsatisfactory, considering the large role education 
is to play in the new society. The people must be able to see for 
themselves that the preferred educational program is of genuine and 
uemonstrable benefit to them in satisfying their needs before it will 
be successful. Unless the rewards resulting from engaging in educa- 
tional activity are those expected and desired by the people and are 
.perceptibly related to meeting their needs, the learning will not be 
effective. This is not to say that a government cannot encourage and 
promulgate new forms or configurations of reward structure or social 
grouping (as they clearly have done in China). But while initial 
compliance can be achieved through persuasion, manipulation, and 
coercion, active support and enthusiastic participation are obtained 
only when the promises and results correlate. 

As an illustration of non-formal education, the Chinese 
experience is different from what we find in North America or In any 
of the less developed nations. It is difficult or impossible to 
classify educational operations in China because of the fuzziness of 
the line between formal and non-formal education. 

As one element of a larger social upheaval, the institutional 
forms of education have been thoroughly restructured. The historic 
roles and modes of education In China were abandoned in some 
particulars and relnstltuted In others. The ideals of egalitarian 
social structure and pragmatic, utilitarian roles for institutions 
are thoroughly reflected In what education h;3s become In the new 
China. F,ducation has apparently become highly functional and 
resolutely accountable to the larger society. Education is expected 
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to "pay off" for the Individual In terms of the good of the community . 
Considering the pragmatic emphasis and the rejection of self- 
glorification, formal education In the classical molds of the Western 
world has little or no placs In the new China. Education that pays 
off in delayed gratifications ("someday you will need to know this"), 
In status-oriented symlaols (grades, diplomas, degrees), and In 
perpetuations of educational opportunity (e.g., the reward of success 
In high school Is eligibility for college) is incompatible with the 
new socio-political structure. (The skeptic may argue that a basic 
human desire for prestige and security or individualistic status may 
ultimately engender a return to personal -advancement formalisms in 
education, even in China. Time will tell.) 

Besides the well documented improvement In physical living 
conditions within China, the socio-educat ional system is providing 
emotional need satisfaction as well. The participants are not 
regarded exclusively as recipients or subjects but are actually 
involved in the formulation and implementation of social and educa- 
tional programs. SEcurity is gained from being (or feeling) involved 
in the decision-making processes that affect an individual's life. 
By real participation in the educational operations, the person 
achieves a sense of greater personal efficacy and worth, countering 
the resignation, passivity, and fatal ism associated traditionally with 
the Chinese peasantry. I^e also gains peer group approval and 
acceptance, thus establishing a more satisfactory personal self-image. 
Collectively, the new system provides a sense of societal achievement. 
The resultant sense of "nation-ness" has been carefully orchestrated 
to give satisfaction to the most humble worker. 

As noted, learning which results from voluntary activity is 
more effective than learning resulting from coerced behavior. In the 
latter case the individual learns how to secure a reward or avoid 
punishment; the desired learning which results is a secondary product. 
The motivating need is not being filled through the learning of the 
skill lor behavior to be learned is actively sought out and internalized 
as a personal need fulfillment, the learning that results is more 
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resilient, substantia), dynamic (in that it leads to maintenance and 
extension as needed or as it provides satisfaction), and occurs much 
more rapidly. Paulo Friere teaches basic literacy to Latin American 
adults in six weeks. According to one source, the Chinese claim to 
teach basic literacy in only twenty hours! 

The kind of total involvement encountered in China in the 
learning process outside of the schools (such as workers learning 
characters pinned to the back of a co-worker, soldiers lea<ning from 
tracts pasted on the butts of guns, or peasants learning about soil, 
weather, and crop conditions through intense observation and discus- 
sion) is learning which is not motivated by coercion or artificial 
inducements. Inf'.sad it appears to be engaged in because it 
genuinely meets the physical and emotional needs of the learners. 

To assume that the Chinese have discovered the ultimate of 
Pavlovian-Skinner ian techniques would be a serious error. Far from 
even a stimulus-response system, an elaborate and even huge dynamic 
feedback approach to social learning is used. 

Stimulus-response learning often affects only surface 
behavior, and the behavioral change is usually narrow and superficial. 
The individual reacts only to a specific stimulus and derives reward 
or punishment from his response to that stimulus. There are several 
potentially negative results: it maintains dependency on the source 
and limits the learner's view of the learning process; it permits 
only a "scatter-gun" approach to learning since each specific stimulus 
must be isolated, tested, and implemented from the top down rather than 
growing from the needs of the participants, and it denies the wider 
possibilities of dynamic learning by ignoring the complexity and inter- 
relatedness of needs and the learning process involved in meeting them. 

In China the kinds of resources the central operatives provide 
are based primarily on data from the universities and research centers. 
The innovation and motivation in implementation come from the people 
themselves who either seek out pertinent data or sele'-t individuals 
whose job it is to stay abreast of developments that might prove 
beneficial to the work brigade or to the entire commune. The concerns 
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of the masses are transmitted through the same process to the bodies 
most likely to effectively deal with them. Sun Yat-sen University, 
for example, devotes the bulk of its research to improving rice 
production. The channels are clearly established and the initiative 
and feedback necessary for continual Information generation come from 
below. 

Consistent with the above, change agents in China usually 
come from the target population or are, at least, readily acceptable 
to them. This insures maximum program effectiveness. The agent 
must be subject to some form of selection process since his authority 
stems from the people's view of his knowledge, competency, and 
expertise, which establishes his source credibility. Many change 
agents in the People's Republic of China are from the peasantry, and 
they are, at the practical (versus the political) level, selected by 
the work brigade members and can be removed by them. The cadre's 
continued personal success is dependent upon his continued demonstra- 
tion of competency in his particular area. The Chinese recognize that 
the exercise of arbitrary power precludes the possibility of the 
development of self-diijtection and confidence necessary for further 
active acceptance of innovation. Therefore, their change agents, at 
least at the practical , and educational levels, cannot derive their 
credibility or authority from status but must depend instead upon 
their proven ability to help meet the needs of the people who accept 
their authority. 

Extolling the virtues of education in the People's Republic of 
China is not our purpose. We do not even intend to suggest that a 
complete merger or a dissolution of the lines separating the formal 
and non-formal educational enterprises is necessarily desirable. In 
fact, the political price for such merger seems quite high; at the 
base it suggests a complete nationalization (or, at least, pol itical iza- 
tion) of all aspects and functions of education. Some regimes may be 
unwilling to accept such a heavy responsibility; others may be too 
willing, only to find the people unwilling. In the Chinese case, the 
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solution for this dilemma would seem to have been found, for now at 
least, in the complete Identification of the masses with the 
pol 1 t lea 1!zat Ion process. 

What we do Intend Is to call attention to the Chinese experi- 
ence as an example of profound restructuring of education to bring It 
Into close relationship to the stated goals of the society. Learning 
effectiveness Is then definable In terms of the social goals of a 
body politic far larger than those that exist within a single social 
institution. 

The major observations and generalizations that are drawn 
from the Chinese experience follow: 

1. The distinction between formal and non-formal education 
is virtually meaningless in this highly functional 
concept of education. 

2. A wide range of educational modes are employed to effect 
a total system. ^ 

3. Less emphasis is placed on graded, sequenced, general 
schooling than on specific task-skill oriented training. 

k. Educational opportunity is itself a reward for service 
to the society, rather than a basic right. 

5. The rewards for effective learning exist less in the 
school or the educational program than in the larger 
experience of life in which the learning is applied. 

This fifth point, that the rewards for effective learning 
exist in life experiences rather than in the arbitrary institutional 
reward systems typical of schools and schooling, may represent the 
key to the vigor and durability of the educational reforms in China. 
Educational accomplishment insofar as those accomplishments are valid 
and real must be rewarded in some way. Only in the most idealistic 
sense is learning Its own reward. A reinforcing "pay-off" must some- 
how be provided. Reinforcement theories of learning all share a 
tenet regarding the need for reinforcement If behavior is to be pre- 
dictably repeated. Even those who reject reinforcement theories find 
some place in their own theories for rewards for satisfactory per- 
formance of learning tasks. Most of the practical socializations 
(learning of life skills) are rewarded by the satisfactions of 
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functional communication, effective interpersonal transactions, and 

the satisfaction of human appetites. Thus, what one learns In early 

childhood and pre^adult years through the informal modes leads to 

functional satisfactions. Not so with what schools are typically 

concerned} since the reward structures of the student's larger 

society do not naturally and functionally reward the learnings that 

the school sponsors, endorses, and Induces, an artificial reward 

structure must be created by the school so as to Increase the proba" 

bilityof learning. Hence, grades, promotions, certificates, degrees, 

commendations, praise, and exemptions from punishments become the 

substitutes for real rewards that are lacl<ing. Yee observes! 

Explaining educational opportunity and purpose to a child 
seems easier In China than in the U.S. not Just because 
alternatives for one's attentions are lacl<ing there. With 
so mt ch stress on applications and service, the Chinese do 
not postpone gratification In educational achievement. The 
child asl<sf why he cannot go, not why he must go to school! 
Chinese education Is continuous with and not just preparatory 
to actual participation In the community. Yet the difference 
in schools may be more adequately attributed to the different 
roles and attitudes expected of the young. Also, the greater 
structuring of social systems In affluent nations of the West 
assigns and separates people by relevant Indices, e.g., age, 
sex, training, means, etc. In terms of handling basic human 
activities simply, cooperatively, and independent of unseen 
others, the Chinese better resemble pioneer than modern 
Americans. 37 

Non-format education, to the extent that It Is focused on 
practical, applicable learnings that have Immediate social and economic 
rewards. Is less lUely than formal education to resort to the creation 
of an artificial or substitutionary reward structure. Much non-formal 
education Is valued by learners because of their explicit desires for 
the life-changing effects of the learning. It Is true, however^ that 
in a society dominated by a formal educational establishment, non- 
formal educational programs may sometimes be designed with their own 
systems of artificial rewards slavishly mimicking the formal schools. 
Given a society wherein people expect certificates, grades^ and the 
life, this may be necessary, no matter how absurd It may seem. Such 
Is the colonial legacy! 
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THE REWARD SYSTEM OF SCHOOLING 



THE REWARD SYSTEM OF INTRINSIC 
LEARNING 



Symbolic 
Delayed 



Functional 



Imediate 



Linked to Testable Behavior .... Linked to Demonstrable Behavior 



(This chart is to some extent an exaggeration for the purpose of 
ilustration. The differences indicated arc usually apparent— easy 
enough to see, though rarely in extreme or mutuaily exclusive forms*) 

Figure 3. "Contrast of Reward Systems: Schooling and 
Intrinsic Learning. 

The Chinese situation Is virtually unique at this very point: 
artificial reward systems for learning— formal or non-formal— are 
less necessary (perhaps unnecessary altogether, If we are to believe 
the reports) for the very reason that the society does not create an 
expectation of extrinsic rewards. Thus, educational experiences are 
expected to "pay off," not In symbols and status but In uses and 
satisfactions from those uses. With reference to education, the 
social revolution In China has had the effect of uncoupling schools 
from the symbolic reward structures characteristic of formal education. 
Now schools and non-school programs of learning are linked to the 
reward system of the larger society. Becoming learned— effectively 
learned— Is rewarded by the use of one's learning to better his 
community, his nation, and. In turn, himself. 

Implicit In these observations Is the recognition that the 
effectiveness of the Chinese educational system Is clearly related 
to and dependent on Its ability to accurately and constantly Identify 
the emotional and physical needs of the educational participants and 
to effectively meet those needs through Its educational programs, In 
fact, the success of the entire Chinese social revolution appears 



Individualistic Values (Self 
has meaning in terms of 
Personal Goals) . . 



Group Values (Self has meaning 
in terms of contribution to 
Group Goals) 
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largely dependent on the Chinese people perceiving their needs being 
met through their Involvement and support. And to Insure continuous, 
energetic participation, these perceived needs must In fact be met. 
Promise and reward must correlate, and In China, for the time being 
anyway, this critical correlation seems very close. 

Conclusions 

Some- of the attempts to copy or "adapt" the Maoist principles 
for applications In Latin America and East Africa have failed to 
recognize the crucial function of the Chinese reward system. There 
may be some lessons to learn from the techniques of Instruction and 
the modes of educational delivery used In China today, though they 
seem to be neither particularly modern nor remarkably sophisticated 
by technological standards. There may be other lessons to learn from 
the blurring of the sharp distinctions between the formal and non- 
formal modes of educat Ion— and these lessons would prove Inspiring 
for those who need to recognize the validity of an Integration between 
community living and life-long learning. But the most profound 
lessons to learn from the Chinese experience is In reference to the 
need for alignment of the value system and reward structure of the 
educational programs of the nation with the goals, value system, and 
reward structures of the nation as a whole— and to harmonize these 
two In an honest recognition of the validity of human life, liberty, 
and the pursuit of Individual and corporate happiness. 

When you talk of developing non-formal education programs 
which can be plucked out and plugged Into the needs of 
various developing countries, It sounds typical of our 
Western approach. It's a bit mechanistic. You are In a 
sense disregarding the concrete conditions o^ that particu- 
lar society, Its aspirations and needs, ItJ .nrtorlcal 
factors, etc. In China certain things workeu .n the 
Chinese system which may be exported to other countries, 
and perhaps a modified version of it will work. But some 
things that work there may not work elsewhere because the 
chemistry Is different. 37 
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ULTIMATE TARGET POPULATION} 

The entire Chinese nation. Built into Mao's concept of 
education is confidence in the unlimited capacity of the 
unfettered masses to transform the society and material 
conditions of China, 

SELECTION OF TARGET POPULATION FOR 
PARTICULAR EDUCATIONAL EXPERIENCES} 

Individuals best suited to transmit educational gains for 
the benefit of others. On the basis of his political party 
dedication to the masses, an individual is educated so long 
as he puts the nation before himself. To a great extent 
selection is made by the masses, by the candidate' s peers. 
Individual motivation and elitism is selected out and 
education ceases to be an "entrance way to power and 
wealth." 

GOAL: 

A new society based on equality, socialism, cooperation, 
and self -reliance. Implicit in this goal is the need for 
an "educated non-elite." Education is the primary instru- 
ment for the "spiritual" transformation of man and society— 
the bringing forth of a new kind of selfless person, 
committed to the Maoist goal "serve the people." At the 
same time educational institutions are needed to train 
competent and skilled workers for every sector of produc- 
tion. The two goals ccxnbine in the idea of the, all- 
round man, the "cultured worker"— a concept that seeks 
to eliminate the rank and privilege differentials between 
the "mental aristocrats" and manual workers. 

REWARD SYSTEM} 

Increased individual well-being, material and emotional, 
through collective nation-building. Each individual 
becomes an integral part of his immediate group which in 
turn directly interlocks with larger groups until these 
see themselves as the entire nation. Individual well- 
being is inextricably bound up in the overall development 
of the nation ("the people") . The individual can prosper 
only in terms of the larger group. The greater his 
personal contribution, the greater his self-esteem and 
sense of having fulfilled his obligation to his country 
and countrymen. 

Figure A. --Societal Acliievement Model of Cliinese Education. 



ERIC 



ootm 



360 



The question of whether and to what extent the Chinese 
educational mode) Is general Izable to other less Developed Countries 
Is one that Is probably largely unanswerable. It Is true that the 
Chinese system grew up In response to specific demands and conditions 
within China, Presumably to the extent that these factors are 
similar In other situations, It would appear that elements of China's 
solutions might be applicable. On the other hand, It would appear 
equally clear that China's experiences cannot be duplicated, and to 
that extent the Chinese solutions must be modified to fit the 
objectives and problems of another locale. Mao has stated that 
revolution Is not exportable, and this Includes the educational 
revolut ion as wel 1 . 

Some observers have noted that China's educational experiment 
Is still, and may always be, too fluid to regard as a pattern or 
"model." To the degree that they are speaking of an educational 
package, a kind of teacher-student proof national education kit that 
can be shipped intact and effectively Implemented in another social 
and cultural milieu, they are hardly to be disputed. This has 
been precisely the mistake made by Western educators for the past 
century In trying to export their model to countries whose conditions 
and needs were vastly different. The rationalization for the seemingly 
irrational belief In the appropriateness of one educational philosophy 
and educational structure for the entire world appears to lie In the 
ethnocentric conviction that only a complete and utter socioeconomic 
transformation to the Western model constitutes genuine development. 
A country's "progress" can thus be determined by the extent of Its 
emulation of the Western Industrial, capitalist. Individualist model. 
In education the pathetic results--el Itlst leaders proficient In 
ludicrously Irrelevant areas with little understanding of or compassion 
for the conditions of the masses, an*d compulsory education with no 
national purpose and of little practical value— have tragically 
throttled and constrained nations embarklnjj v.i the developmental 
process, 
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But many less developed countries are becoming aware of the 
Inappropr lateness of an alien system In meeting national needs. The 
presence of vast numbers of educated unemployables In a poverty 
stricken nation who are unwilling to dirty their hands and the 
realization that up to three-fourths of a country's youth will be 
out of school by 1980^^ has forced educational planners to re- 
evaluate their educational policies and to examine new alternatives. 

To treat the Chinese educat Ion model prescrlptlvely then 
would be to repeat the mistake made by the purveyors of Western formal 
schooling who presented It as a panacea. But to the extent that 
China's system reflects new approaches to common problems, It is a 
significant Innovation In national educational planning with broad 
International Implications that cannot be Ignored. To understand 
the fundamental components of the Chinese model as they now apply to 
the needs and problems of other developing countries, It should be 
useful to glance at another country's situation, the faults and 
shortcomings of Its present educational system, and some solutions 
suggested by the China model. 

It may be pointed out that Tanzania, as the biggest recipient 
of Chinese aid, is not an entirely reliable example to examine. 
Inasmuch as the educational problems President Nyerere outlines are 
nearly universal among less developed countries and since the close 
cooperation between China and Tanzania suggests a certain commonality 
of social objectives. It would seem that, for our purposes, Tanzania 
Is quite. acceptable. In a recent article, "Education for Self- 
Rel lance," Joseph Nyerere, President of Tanzania, Identifies four 
main difficulties with his country's educational system. 

1. "The education we are providing Is basically an elitist 
education designed to meet the Interests and needs of a 
very small proportion of those who enter the school 
system. Although only about 13% of our primary school 
children will get a place In a secondary school, the basis 
of our primary school education Is the preparation of 
pupils for secondary schools. Thus 87% of the children 
who finished primary school last year do so with a sense 
of fall ur The other 13% have a feeling of having 
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deserved a prize—and the prize they and their parents 
expect Is high wages, comfortable employment In towns, 
and personal status In the society.** 

2. "Tanzania's education Is such as to divorce Its partici- 
pants from the society It Is supposed to be preparing them 
for .... The school Is a place children go to at age 
seven and which they and their parents hope will make It 
unnecessary for them to become farmers and continue 
living In villages.** 

3. . . our present system encourages school pupils in the 
idea that all knowledge which is worthwhile is acquired 
from books or from 'educated people* --meaning those who 
have been through a formal education .... Government 
and party tend to judge people according to whether they 

. . . *have a degree* .... If a man has these qualifi- 
cations, we assume he can fill a post .... If a man 
does not have these qualifications, we assume he cannot 
do a job; we ignore his knowledge and experience.** 

^« . . our poor nation is taking out of productive work 
some of its- healthiest and strongest young men and women 
.... How many students spend their vacations doing a 
job which could improve peoples' lives . . . ?"39 

To paraphrase, Nyerere is saying that Tanzanlan education is 
elitist in that it cultivates feelings of individual superiority, is 
largely irrelevant to the concrete needs of the country, credentials, 
values, and rewards only formal learning, and withdraws a significant 
portion of the labor force from productive work. Each one of these 
concerns has been artlcuMted and repeatedly confronted in China. 
Together they present som^ of the prime targets of the Cultural 
Revolution's educational reform; the question of elitist education 
formed the basis for the entire Red vs. expert struggle. Furthermore, 
virtually Identical lists of problems could well be drawn up by 
practically every less developed country. The problems China has 
found In Its struggle to create a viable, nation-serving system of 
education are not restricted to a single country; to varying degrees 
and In various forms, they are the same educational issues plaguing 
nations, developed and undeveloped, all over the world. 
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The Chinese people have made great strides towards creating a 
new, Indigenous, collectivized educational system to meet 
China's needs, They are determined to avoid developing an 
overeducated elite with no function to perform In society, 
such as that which Western-style education has created In 
many developing nations, Although the Chinese describe 
their far-reaching educational experiment as turning "the 
whole country Into a great school of Mao Tse-tung thought," 
the problems they are grappling with are universal ,**0 

Those who claim that China's experiment Is too fluid to be 

regarded as a model are, as mentioned, partially correct. Grappling 

with common problems and arriving at absolute, common solutions are 

not necessarily related. Thus far the grappling in China has tal<en 

the form of radical experimentation and perhaps It Is this process of 

examination, trial, and evaluation that Is China's real contribution 

to world education rather than her tentative conclusions. Models as 

prescriptions have not proven very effective when shipped intact from 

y 

point of origination to new situations. To the extent that a model 
has developed historically out of concrete experience and local 
social conditions and needs, they continue to fill those functions 
even though the purposes may be totally inappropriate to their new 
situation. In China, specific local needs and national objectives 
produced a situation that clearly demanded entirely new conceptions 
of education; given the political philosophy and social aspirations 
of the Communists, no existing model was adequate for their needs. 
The procedure for discovering and developing this "new, indigenous, 
collectivized educational system to meet China's needs" meant 
revolutionizing their educational structure and perhaps even more 
importantly, revolutionizing their educational perspective. 

Many countries. If not all, castigate almost constantly the 
shortcomings of their educational system. There is little risk 
involved in criticism and little possibility of change. Even when 
change does occur, it rarely goes beyond moderate reform. The 
reasons for this are numerous, probably the most obvious being that 
many of the educational critics and most of those In a position to 
actually implement change are successful products of the existing 
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system and are going to be reluctant to threesten their own elite 
status by radically restructuring that system, But another factor 
that deserves some attention Is the simple limitation Imposed upon 
educational planners by their own experience and the lack of exposure 
to alternative educational modes. For years many less developed 
countries have been aware of the failure of formal education In their 
countries and have not hesitated to bitterly attack Its operation, 
Yet little has been accomplished since the usual "solution" has been 
a variation on the Idea that the answer to all problems Is "more of 
same," Failings were not due to fundamental systemic defects, but 
to a lack of quantity (number of schools) or quality (number of books, 
qualified teachers, etc., etc.). This way of viewing problems has 
been dubbed "old think"— the answers to new problems are more of the 
old "solutions." 

The point Is that as long as a country Is mired In "old think" 
and cannot accept genuinely revolutionary perspectives. Its ability to 
substantially turn Its educational system around Is severely limited. 
As a case in point, one of the most innovative aspects of China's 
educational experiment has been a virtual elimination of the division 
between formal and non-formal educational sectors. They simply 
rejected the distinctions and through practice allowed a system to 
develop that Integratjed the two. They were able to escape the 
restrictions of what might well be a false distinction, and In China's 
case at least was certainly an irrelevant one. The procedure for 
creating an indigenous mass educational system Is thus exportable to 
other situations onTy if their leaders are capable of erasing the 
dichotomy In their own minds between formal and non-formal education. 
This requires a radically new perspecttvfc of eojcation that Is not 
bound by previous expectations, old formulas, or colonial models, 
but is Instead dependent on the relatively organic, unstructured growth 
of a system which springs from the needs, conditions, and expectations 
of the. people themselves. 
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Specifically, nations looking to China's experiment for 
direction must be willing to loosen central control of policy 
generation and implementation. The China experience suggests that 
only the most general kinds of objectives and policies can be 
determined centrally, and that even those had better have some direct 
benefit for the people if a system of mass education and balanced 
development is to be genuinely effective. This means drastic decen- 
tralization of school operation, curriculum planning, and educational 
control. Only in this way can the people become truly involved In 
the educational process on a mass level and mold It to meet their 
concrete needs anct eflect their local conditions. But before a 
nation can do thhi, It must be able to see education not as a period 
of lock-step labor In the schools or a function of rural extension 
teams, but as a process that occurs at every level of society and In 
"every facet of life." It is a process that doesn't ossify Into a 
"model," but It changes, creates, and modifies as the country's needs 
and conditions fluctuate. This is the essence of China's educational 
experiment, and It Is this broad revolution in educational thinking, 
not another pre-packaged set of educational recipes, that Is China's 
contribution to world educational planning. 
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Paul HInlker, ",Mass Media and Study Groups In Commgnlst 
China," In Mass Comtinication >mti the Development of Nations, pp. vl-l4. 
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Marilyn TInsman, "Chinese Educational Development In the 
20th Century," In Problems of Educational Development and Modernization 
in Asia, p. 106. 

Wing-tsit Chan, A Sourcebook in Chinese Philosophy, See 
also Menclus' "bare hill" analogy. 

Peter J. Seybolt, "The Yenan Revolution In Mass Education," 
The China Quarterly, Vol. (October-December, 1971), 6/JI-6A2. See 
also Mao Tse-tung, "On Practice." 

^Ibid,. p. 650. 

^Xbidf p. 66^*. 

'Franz Schurmann, ideology and Organization in Cotmunist 
China f p. 582. t ' . 
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Victor Nee and John N. Layman, "The Cultural Revolution at 
Peking University," A/onthly i?eview, Vol. 21 (July-August, I969). 
Unless otherwise noted, figures relating to the class makeup of 
student bodies are drawn from this source. 
9 

John Israel, "Politics and Education In China: The Chinese 
Student Movement," In Problems of Educational Development and 
Modernization in Asia, p. 7« 

'^Seybolt, op, cit., pp, 668-669. 

'^Joseph Lee, unpublished Interview. 
12 

Ross Terrlll, The 800,000,000, The Real China, This Is the 
highest figure encountered. Fraser puts the literacy rate among adults 
at kS% while Yee estimates the figure to be around 60^. 

13 

•'Rhea Menzel Whitehead, "How the Young are Taught In Mao's 
Chiha," .Sfafcurday i?eview, March 4, I972, p. Hi 

Terr 1 1 1 , op, cit, , p, 9. 
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'^Stewart E. Fraser and John N. Hawkins, "Chinese Education: 
Revolution and Development," Phi Delta Happ&n, Vol. 52 (April, 1970), 
^95. 

'^Whitehead, op. cit,, p. AA. 
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'Terr 1 11, op, cit. 
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^Terr 1 11, op, cit. 



Fraser, op, cit,, p. ^96. 
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Fraser, op, cit, 

22 

Terr 1 1 1 , op. cit, 
^^Fraser, op, cit. See p. A98. 

Ibid, 

^^Peter Shursberg, "The May 7 Schools," Newsweek, Vol. 99 
(June lA, 1970, 50. 

^^Fraser, op. cit,, p. A99. 
28 

Lee, op, cit, 
^^See Lewis, Gourlay and Hlnlker. 

^^John Wilson Lewis, Leadership in Communist Society, p. 187. 

^'v/alter Gourlay/ The Chinese Communist Cadre, Key to 
Political Control, p. 5. 

^^Htnlker, op. ait. According to Hlnlker, "Communist China 
utilizes formal face-to-face discussion groups to supplement the con- 
sumption of her mass media to a greater extent than any other nation 
In the world," pp. vl-5. 

^^Ibid,, pp. vl-1. 

^^Ibid,, pp. vl-3. 

•^•^Lee, op. aib. 
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^ UNESCO, "A Statistical Analysis of Out-of-School Youth In 
Asia," unpublished report, 1973, 

^^Jullus Nyerere, "Education for Self-Reliance," Africa Report, 
Vol. 12 (June, 1967), 38. . 
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Whitehead, op. cit., p. 12. 



ERIC oo:m 



BIBLIOGRAPHY 



BEST COPY AVAiUIBLE 

Barnett, Doak. cadres, Bureaucracy and Political Power in Comunist 
Chinci, New York: Columbia University Press, 1 967. 

Bdstid, Marianne. "Economic Necessity and Political Ideals In 

Educational Reforms During the Cultural Revolution." The 
China Quarterly, Vol. 12, (April-June, 1970), 

Chan, Wln<5**tstt. A Sourcebook in Chinese Philosophy* Princeton, N.J.: 
Princeton University Press, 1963- 

Ch'en, Jerome. Mao and the Chinese Revolution. New Yorks Oxford 
University Press, 1965. 

Fraser, Stewart. Chinese Communist Educations Records of the First 
Decade. Nashville: Vanderbllt University Press, 1965* 

Fraser, Stewart E.\ and Hawkins, John N. "Chinese Education: 

Revolution and Development," Phi Delta Kappan, Vol. 52, 
No. 8 (April, 1972), '♦87-500. 

Gait, H. S. History of Chinese Educational Institutions, Vol. 1. 
London: Stephen Austin and Sons, 1951* 

Gedden, W. R. peasant Life in Comunist China. Ithaca, N.Y.: Society 
for Applied Anthropology, 1963« 

Gourlay, Walter. The Chinese communist Cadre, Key to Political Control 
Unpublished, 1952. 

HIniker, Paul J. "Mass Media and Study Groups In Communist China," in 
Mass Communication and the Development of Nations t ed. by 
David K. Berlo. East Lansing, Mich.: International Communica- 
tions Institute, 1968. 

. Unpublished notes on the Chinese Communist social and 
political system, 1969< 

Israel, John. "Politics and Education in China: The Chinese Student 
Movement," in Problems of Educational Development and 
Modernization in Asia, ed. by Peter Hackett. Char lottsvl 1 le: 
University of Virginia Press, 1972. 



369 



370 

BEST COPY AVMIABU 

King, V. S. Propaganda Campaigns in Comunist China* Cambridge, 
Mass.: MIT Press, 1966* 

Lee, Joseph. Unpubltshed Interview, January 25, 1973* 

Lerner, Daniel. The Passing of Traditional Society* New YorkJ 
Free Press of Glencoe, 1958. 

Lewis, John Wilson. Leadership in Comunist Society* Ithaca, N.Y*: 
Cornell University Press, 1963* 

Liu, Allan P. L. The Film Industry in Communist China, Cambridge, 
Mass. : MIT Press, 1966. 

♦ The Press and Journalism in Communist China* Cambridge, 
Mass. : MIT Press, 1964. 

. Radio Broadcasting in Communist China* Cambridge, Mass.: 
MIT Press, 1964. 

. The Use of Traditional Media for Modernization in 
Communist China* Cambridge, Mass.: MIT Press, 1965. 

Myerere, Julius. "Education for Sel f-Rel lance." Africa Report* New 
York: The African-'Amer lean Institute, Inc., Vol. 12, No. 6 
(June, 1967), 72-79. 

Nee, Victor and Layman, Don. "The Cultural Revolution at Peking 
University," Monthly /{evieti^/ Vol. 21 (July-August, 1969), 
1-91. 

Price, R. T. Education in Communist China* London: World Education 
Series, 1970. 

Seybolt, P-^ter J. "The Yenan Revolution In Mass Education," The 

China Quarterly, Vol. 48 (October-December, 1971), 641-669. 

Schurman,' Franz. Ideology and Organization in Communist China* 
Berkeley: University of California Press, 1968. 

Schram, Stuart. The Political Thought of Mao Tse-'tung* New York: 
Frederick A. Praeger, 1967. 

Sen. Lai it K. "The Concepts of Tradition and Modernity: a Re- 
Evaluation." Unpublished paper prepared for the Second 
World Congress of Rural Sociology, I968. 

Shursberg, Peter. "The May 7 Schools," Newsweek, Vol. 99 (June 14, 
1971), pp. 50-53. 



ootids 



371 

BEST COPY AVAILABLE 

Teng and Lew. Education in china, Peking; Society for the Study of 
International Education, 1923* 

Terr in, Ross. The 800,000,000, The Re&.l China, New York: Oell, 
1972. 

Tinsman, Marilyn. "Chinese Educational Development In the 20th 
Century," In Problems of Educational Development and 
Modernization in Asia, ed. by Peter Hackett. Charlottsvi lie: 
University of Virginia, 1972. 

Whitehead, Rhea Menzel. "How the Young are Taught In Mao's China." 
Saturday Review, March k, 1972, pp. hO-kS* 

Yang, C. K. Chinese Communist Society: the Family and the village, 
Berkeley: University of California Press, I968. 

Yee, Albert H. "Schools and Progress In the People's Republic of 

China." Education Research, Vol. 2, No. 7 (July, 1973), 5-15. 

Yu, F. T. C. Mass Persuasion in Communist china. New York: Praeger, 
196i». 

. "Some Notes on Communication and Development Policy In 
Communist China." Unpublished, 196^^.. 



00379 



